Max level shown:
1 [ Nov 27 18:34:20 Enabled. ]
2 [ Nov 27 18:34:20 Rereading configuration. ]
3 [ Nov 27 18:34:22 Rereading configuration. ]
4 [ Nov 27 18:34:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 27 18:34:27 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-27T18:34:27.483ZDEBGnexus: registered DTrace probes
82024-11-27T18:34:27.484ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-27T18:34:27.493ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-27T18:34:27.493ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-27T18:34:27.508ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-27T18:34:27.510ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-27T18:34:27.514ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-27T18:34:27.520ZDEBGnexus (ServerContext): registered USDT probes
672024-11-27T18:34:27.659ZINFOnexus: Database schema version is up to date desired_version = 116.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 116.0.0
682024-11-27T18:34:27.663ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 236c7b74-8315-46e3-9a37-90380a675558
692024-11-27T18:34:27.663ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2101, tv_nsec: 661989093 } })
702024-11-27T18:34:27.664ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-11-27T18:34:27.714ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-11-27T18:34:27.714ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-27T18:34:27.723ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3813b110-e2d0-4bc2-9aa1-4d30e17fe38a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:27 GMT"} })
742024-11-27T18:34:27.723ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-27T18:34:27.724ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-27T18:34:27.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2101, tv_nsec: 753590020 } })
772024-11-27T18:34:27.755ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-11-27T18:34:27.787ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-11-27T18:34:27.787ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-27T18:34:27.787ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc711f54-c936-450d-9898-f39d6650fb5f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:27 GMT"} })
812024-11-27T18:34:27.787ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-27T18:34:27.788ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-27T18:34:27.854ZDEBGnexus (clickhouse-client): registered USDT probes id = 4118e9f4-3835-4ccf-9a4e-1e34e08e34d9
842024-11-27T18:34:27.860ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-11-27T18:34:27.868ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-11-27T18:34:27.869ZDEBGnexus (DataLoader): attempting to create built-in users
872024-11-27T18:34:27.869ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-11-27T18:34:27.870ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
912024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
922024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
942024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
952024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1012024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1142024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1162024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1192024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1212024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1262024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1272024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-11-27T18:34:27.888ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12221
1322024-11-27T18:34:27.888ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1332024-11-27T18:34:27.889ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-11-27T18:34:27.889ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-11-27T18:34:27.927ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1362024-11-27T18:34:27.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-11-27T18:34:27.928ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-11-27T18:34:27.929ZDEBGnexus (DataLoader): attempting to create built-in roles
1392024-11-27T18:34:27.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-11-27T18:34:27.929ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-11-27T18:34:27.948ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1422024-11-27T18:34:27.948ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432024-11-27T18:34:27.949ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442024-11-27T18:34:27.949ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1452024-11-27T18:34:27.949ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-11-27T18:34:27.949ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-11-27T18:34:27.968ZWARNnexus: Cannot look up rack: Object (of type ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2)) not found: rack file = nexus/src/app/rack.rs:774
1482024-11-27T18:34:28.500ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:47778
1492024-11-27T18:34:28.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 98e89456-fc18-464b-bd4e-2e2e8c21ced3 roles = RoleSet { roles: {} } uri = /metrics/collectors
1502024-11-27T18:34:28.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 98e89456-fc18-464b-bd4e-2e2e8c21ced3 resource = Database result = Ok(()) uri = /metrics/collectors
1512024-11-27T18:34:28.561ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1522024-11-27T18:34:28.561ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-11-27T18:34:28.563ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-11-27T18:34:28.563ZDEBGnexus (DataLoader): attempting to create built-in silos
1552024-11-27T18:34:28.563ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-11-27T18:34:28.563ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-11-27T18:34:28.569ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:41
1582024-11-27T18:34:28.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68085 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 98e89456-fc18-464b-bd4e-2e2e8c21ced3 response_code = 204 uri = /metrics/collectors
1592024-11-27T18:34:28.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 836a1c59-b4cb-4996-8c33-b33f0ee65c28 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
1602024-11-27T18:34:28.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 836a1c59-b4cb-4996-8c33-b33f0ee65c28 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
1612024-11-27T18:34:28.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 836a1c59-b4cb-4996-8c33-b33f0ee65c28 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
1622024-11-27T18:34:28.716ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1632024-11-27T18:34:28.716ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-27T18:34:28.717ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-27T18:34:28.738ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-27T18:34:28.738ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-27T18:34:28.738ZDEBGnexus (DataLoader): attempting to create built-in projects
1682024-11-27T18:34:28.738ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-11-27T18:34:28.739ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-11-27T18:34:28.744ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-11-27T18:34:28.745ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-11-27T18:34:29.128ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-11-27T18:34:29.128ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1742024-11-27T18:34:29.135ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752024-11-27T18:34:29.136ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1762024-11-27T18:34:29.136ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-11-27T18:34:29.137ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782024-11-27T18:34:29.181ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-27T18:34:29.181ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-27T18:34:29.590ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-11-27T18:34:29.592ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1822024-11-27T18:34:29.592ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-11-27T18:34:29.592ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-11-27T18:34:29.688ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1852024-11-27T18:34:29.688ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-27T18:34:29.689ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-27T18:34:29.689ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1882024-11-27T18:34:29.689ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-11-27T18:34:29.690ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-11-27T18:34:29.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-11-27T18:34:29.704ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-11-27T18:34:29.705ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-11-27T18:34:29.705ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-11-27T18:34:29.706ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-11-27T18:34:29.707ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-11-27T18:34:29.708ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-11-27T18:34:29.708ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-11-27T18:34:29.709ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-11-27T18:34:29.712ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2002024-11-27T18:34:29.712ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-11-27T18:34:29.713ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-11-27T18:34:29.968ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2032024-11-27T18:34:29.969ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2042024-11-27T18:34:29.970ZWARNnexus: Cannot look up rack: Object (of type ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2)) not found: rack file = nexus/src/app/rack.rs:774
2052024-11-27T18:34:30.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-27T18:34:30.146ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-11-27T18:34:30.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-27T18:34:30.148ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-27T18:34:30.149ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-27T18:34:30.151ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2112024-11-27T18:34:30.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-27T18:34:30.152ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-11-27T18:34:30.202ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-27T18:34:30.202ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-27T18:34:30.203ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-11-27T18:34:30.204ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-11-27T18:34:30.205ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-11-27T18:34:30.205ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-11-27T18:34:30.206ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-27T18:34:30.209ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2212024-11-27T18:34:30.209ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-27T18:34:30.209ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-11-27T18:34:30.224ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-27T18:34:30.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-11-27T18:34:30.234ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-27T18:34:30.234ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-27T18:34:30.249ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-27T18:34:30.249ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-11-27T18:34:30.250ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-27T18:34:30.250ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-11-27T18:34:30.252ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-27T18:34:30.252ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-27T18:34:30.253ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-27T18:34:30.256ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2352024-11-27T18:34:30.256ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-27T18:34:30.256ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-11-27T18:34:30.312ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-11-27T18:34:30.312ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-11-27T18:34:30.313ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-27T18:34:30.313ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-27T18:34:30.314ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-11-27T18:34:30.314ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-11-27T18:34:30.346ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-11-27T18:34:30.349ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2452024-11-27T18:34:30.349ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-11-27T18:34:30.350ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-11-27T18:34:30.422ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-11-27T18:34:30.422ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-11-27T18:34:30.424ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-11-27T18:34:30.425ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-11-27T18:34:30.427ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-11-27T18:34:30.427ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-11-27T18:34:30.428ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-11-27T18:34:30.431ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2552024-11-27T18:34:30.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-11-27T18:34:30.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-11-27T18:34:30.507ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2582024-11-27T18:34:30.507ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-27T18:34:30.508ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-11-27T18:34:30.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-27T18:34:30.517ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-11-27T18:34:30.519ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-11-27T18:34:30.519ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-11-27T18:34:30.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-11-27T18:34:30.535ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-11-27T18:34:30.539ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-11-27T18:34:30.539ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-11-27T18:34:30.540ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-11-27T18:34:30.540ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-11-27T18:34:30.544ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-11-27T18:34:30.547ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2722024-11-27T18:34:30.547ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-11-27T18:34:30.547ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-11-27T18:34:30.549ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-11-27T18:34:30.549ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-11-27T18:34:30.550ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-11-27T18:34:30.551ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-11-27T18:34:30.552ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-11-27T18:34:30.555ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2802024-11-27T18:34:30.555ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-11-27T18:34:30.555ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-11-27T18:34:30.567ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-11-27T18:34:30.567ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-11-27T18:34:30.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-11-27T18:34:30.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-11-27T18:34:30.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-27T18:34:30.571ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-27T18:34:30.572ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-27T18:34:30.575ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2902024-11-27T18:34:30.575ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-27T18:34:30.575ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-27T18:34:30.717ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2932024-11-27T18:34:30.717ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2942024-11-27T18:34:30.717ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-27T18:34:30.717ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-27T18:34:30.730ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-27T18:34:30.730ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-27T18:34:30.733ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-27T18:34:30.733ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-27T18:34:30.750ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-27T18:34:30.750ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-27T18:34:30.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-27T18:34:30.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-27T18:34:30.753ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-27T18:34:30.753ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-27T18:34:30.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-27T18:34:30.758ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3082024-11-27T18:34:30.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-27T18:34:30.758ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-27T18:34:30.767ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-27T18:34:30.767ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-27T18:34:30.768ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-27T18:34:30.769ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-27T18:34:30.770ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-27T18:34:30.770ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-11-27T18:34:30.771ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-27T18:34:30.774ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3182024-11-27T18:34:30.801ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-27T18:34:30.801ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-27T18:34:30.834ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-27T18:34:30.834ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-27T18:34:30.838ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-27T18:34:30.838ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-27T18:34:30.839ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-27T18:34:30.839ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-11-27T18:34:30.840ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-27T18:34:30.840ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-11-27T18:34:30.842ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-11-27T18:34:30.845ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3302024-11-27T18:34:30.845ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-27T18:34:30.845ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322024-11-27T18:34:30.875ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-27T18:34:30.876ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-27T18:34:30.887ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-27T18:34:30.887ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-27T18:34:30.888ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-27T18:34:30.888ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-27T18:34:30.889ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-27T18:34:30.889ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-27T18:34:30.891ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-27T18:34:30.893ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3422024-11-27T18:34:30.918ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-27T18:34:30.918ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-11-27T18:34:30.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-27T18:34:30.998ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-27T18:34:31.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-27T18:34:31.006ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-11-27T18:34:31.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-11-27T18:34:31.007ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-11-27T18:34:31.010ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-27T18:34:31.010ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-27T18:34:31.011ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-11-27T18:34:31.014ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3542024-11-27T18:34:31.014ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-11-27T18:34:31.015ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-11-27T18:34:31.037ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-11-27T18:34:31.038ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-11-27T18:34:31.051ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-11-27T18:34:31.051ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602024-11-27T18:34:31.052ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-11-27T18:34:31.053ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-11-27T18:34:31.054ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-11-27T18:34:31.055ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-11-27T18:34:31.056ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-11-27T18:34:31.059ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3662024-11-27T18:34:31.115ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-11-27T18:34:31.115ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-11-27T18:34:31.204ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-11-27T18:34:31.204ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-11-27T18:34:31.214ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-11-27T18:34:31.214ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-11-27T18:34:31.217ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-11-27T18:34:31.217ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742024-11-27T18:34:31.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-11-27T18:34:31.219ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3762024-11-27T18:34:31.221ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-11-27T18:34:31.224ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3782024-11-27T18:34:31.224ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792024-11-27T18:34:31.224ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3802024-11-27T18:34:31.233ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3812024-11-27T18:34:31.233ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3822024-11-27T18:34:31.233ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3832024-11-27T18:34:31.234ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3842024-11-27T18:34:31.234ZDEBGnexus (DataLoader): attempting to create silo users
3852024-11-27T18:34:31.234ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-11-27T18:34:31.234ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3872024-11-27T18:34:31.246ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3882024-11-27T18:34:31.246ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3892024-11-27T18:34:31.246ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902024-11-27T18:34:31.246ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3912024-11-27T18:34:31.254ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3922024-11-27T18:34:31.254ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3932024-11-27T18:34:31.254ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3942024-11-27T18:34:31.258ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3952024-11-27T18:34:31.258ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3962024-11-27T18:34:31.264ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3972024-11-27T18:34:31.264ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3982024-11-27T18:34:31.266ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3992024-11-27T18:34:31.267ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4002024-11-27T18:34:31.267ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4012024-11-27T18:34:31.267ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4022024-11-27T18:34:31.276ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4032024-11-27T18:34:31.276ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4042024-11-27T18:34:31.277ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4052024-11-27T18:34:31.279ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4062024-11-27T18:34:31.279ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4072024-11-27T18:34:31.279ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4082024-11-27T18:34:31.383ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4092024-11-27T18:34:31.383ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4102024-11-27T18:34:31.387ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
4112024-11-27T18:34:31.387ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
4122024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4132024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4142024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4152024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4162024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4172024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4182024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4192024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4202024-11-27T18:34:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4212024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4222024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4232024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4242024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4252024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4262024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4272024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4282024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4292024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4302024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4312024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4322024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4332024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4342024-11-27T18:34:31.391ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4352024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4362024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4372024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4382024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4392024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4402024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4412024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4422024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4432024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4442024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4452024-11-27T18:34:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4462024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4472024-11-27T18:34:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:24:31.391853536 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4482024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4492024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4502024-11-27T18:34:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4512024-11-27T18:34:31.394ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4522024-11-27T18:34:31.394ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4532024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4542024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4552024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4562024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4572024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4582024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4592024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4602024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4612024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4622024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4632024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4642024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4652024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4662024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4672024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4682024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4692024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4702024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4712024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4722024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4732024-11-27T18:34:31.394ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4742024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4752024-11-27T18:34:31.394ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4762024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.185698ms iteration = 1 status = {"error":"no blueprint"}
4772024-11-27T18:34:31.394ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4782024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4792024-11-27T18:34:31.394ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4802024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.912498ms iteration = 1 status = {"error":"no config nor servers"}
4812024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 3.810207ms iteration = 1 status = {"error":"no blueprint"}
4822024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4832024-11-27T18:34:31.394ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4842024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4852024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4862024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4872024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4882024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4892024-11-27T18:34:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4902024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.131577ms iteration = 1 status = {"error":"no config nor servers"}
4912024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4922024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4932024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4942024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4952024-11-27T18:34:31.396ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962024-11-27T18:34:31.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972024-11-27T18:34:31.397ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 395337529 } })
4982024-11-27T18:34:31.397ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 395274128 } })
4992024-11-27T18:34:31.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002024-11-27T18:34:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5012024-11-27T18:34:31.398ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5022024-11-27T18:34:31.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 7.719645ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5032024-11-27T18:34:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5042024-11-27T18:34:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5052024-11-27T18:34:31.399ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5062024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.850857ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5072024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5082024-11-27T18:34:31.399ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5092024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.83\u{b5}s iteration = 2 status = {"error":"no config"}
5102024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5112024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5122024-11-27T18:34:31.399ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5132024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5142024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 541.148\u{b5}s iteration = 2 status = {"error":"no config"}
5152024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5162024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5172024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5182024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5192024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5202024-11-27T18:34:31.399ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5212024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5222024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5232024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5242024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5252024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5262024-11-27T18:34:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5272024-11-27T18:34:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5282024-11-27T18:34:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5292024-11-27T18:34:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5302024-11-27T18:34:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5312024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5322024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5332024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5342024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5352024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5362024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5372024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5382024-11-27T18:34:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5392024-11-27T18:34:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5402024-11-27T18:34:31.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5412024-11-27T18:34:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5422024-11-27T18:34:31.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-11-27T18:34:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5442024-11-27T18:34:31.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5452024-11-27T18:34:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5462024-11-27T18:34:31.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5472024-11-27T18:34:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5482024-11-27T18:34:31.417ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 26.658705ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5492024-11-27T18:34:31.422ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-11-27T18:34:31.425ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5512024-11-27T18:34:31.425ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5522024-11-27T18:34:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5532024-11-27T18:34:31.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 426708684 } })
5542024-11-27T18:34:31.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5552024-11-27T18:34:31.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5562024-11-27T18:34:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5572024-11-27T18:34:31.447ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:24:31.391853536 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5582024-11-27T18:34:31.447ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 56.520007ms iteration = 1 status = {"expiration":"2024-11-27T18:24:31.391853536Z","pruned":[]}
5592024-11-27T18:34:31.449ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 447990539 } })
5602024-11-27T18:34:31.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5612024-11-27T18:34:31.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-11-27T18:34:31.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-27T18:34:31.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5652024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5662024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5672024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5682024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5692024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5702024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5712024-11-27T18:34:31.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5722024-11-27T18:34:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5732024-11-27T18:34:31.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742024-11-27T18:34:31.470ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 79.479578ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5752024-11-27T18:34:31.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5762024-11-27T18:34:31.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5772024-11-27T18:34:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5782024-11-27T18:34:31.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5792024-11-27T18:34:31.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5802024-11-27T18:34:31.473ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5812024-11-27T18:34:31.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.293839ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5822024-11-27T18:34:31.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.341475ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5832024-11-27T18:34:31.475ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5842024-11-27T18:34:31.475ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 84.524183ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5852024-11-27T18:34:31.476ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 85.459477ms iteration = 1 status = {}
5862024-11-27T18:34:31.477ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5872024-11-27T18:34:31.477ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
5882024-11-27T18:34:31.477ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.822917ms iteration = 1 status = {"error":"rack not yet initialized: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2"}
5892024-11-27T18:34:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5902024-11-27T18:34:31.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-11-27T18:34:31.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.842056ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5922024-11-27T18:34:31.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5932024-11-27T18:34:31.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5942024-11-27T18:34:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5952024-11-27T18:34:31.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5962024-11-27T18:34:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5972024-11-27T18:34:31.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5982024-11-27T18:34:31.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5992024-11-27T18:34:31.489ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6002024-11-27T18:34:31.489ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6012024-11-27T18:34:31.490ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b53931bb-5979-43c6-a07b-2b6be0ade57f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6022024-11-27T18:34:31.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6032024-11-27T18:34:31.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6042024-11-27T18:34:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6052024-11-27T18:34:31.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6062024-11-27T18:34:31.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6072024-11-27T18:34:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6082024-11-27T18:34:31.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-27T18:34:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6102024-11-27T18:34:31.498ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6112024-11-27T18:34:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6122024-11-27T18:34:31.500ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6132024-11-27T18:34:31.500ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.344891ms iteration = 1 status = {"error":"inventory collection is None"}
6142024-11-27T18:34:31.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152024-11-27T18:34:31.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6162024-11-27T18:34:31.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6172024-11-27T18:34:31.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6182024-11-27T18:34:31.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6192024-11-27T18:34:31.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6202024-11-27T18:34:31.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6212024-11-27T18:34:31.514ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6222024-11-27T18:34:31.514ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6232024-11-27T18:34:31.514ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6242024-11-27T18:34:31.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6252024-11-27T18:34:31.514ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b5b944-d4d8-41a1-a7df-17103d35c450", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6262024-11-27T18:34:31.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6272024-11-27T18:34:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6282024-11-27T18:34:31.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6292024-11-27T18:34:31.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6302024-11-27T18:34:31.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6312024-11-27T18:34:31.521ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6322024-11-27T18:34:31.521ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6332024-11-27T18:34:31.521ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 130.337612ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6342024-11-27T18:34:31.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 140.824498ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6352024-11-27T18:34:31.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6362024-11-27T18:34:31.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6372024-11-27T18:34:31.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6382024-11-27T18:34:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6392024-11-27T18:34:31.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6402024-11-27T18:34:31.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6412024-11-27T18:34:31.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6422024-11-27T18:34:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6432024-11-27T18:34:31.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6442024-11-27T18:34:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6452024-11-27T18:34:31.557ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6462024-11-27T18:34:31.557ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6472024-11-27T18:34:31.557ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 166.341316ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6482024-11-27T18:34:31.561ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6492024-11-27T18:34:31.562ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 560889053 } })
6502024-11-27T18:34:31.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 172.637968ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6512024-11-27T18:34:31.569ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6522024-11-27T18:34:31.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.445355ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6532024-11-27T18:34:31.570ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6542024-11-27T18:34:31.570ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 179.371839ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6552024-11-27T18:34:31.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 180.537196ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6562024-11-27T18:34:31.573ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6572024-11-27T18:34:31.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 182.692028ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6582024-11-27T18:34:31.574ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6592024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6602024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6612024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6622024-11-27T18:34:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.60121ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6632024-11-27T18:34:31.587ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.29561ms iteration = 1 status = {}
6642024-11-27T18:34:31.596ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6652024-11-27T18:34:31.599ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5fbd76-c187-4675-a8ff-12e4c4e7ebbd", "content-length": "1", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6662024-11-27T18:34:31.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6672024-11-27T18:34:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6682024-11-27T18:34:31.603ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6692024-11-27T18:34:31.603ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 211.930001ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6702024-11-27T18:34:31.603ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 212.142625ms iteration = 1 status = {}
6712024-11-27T18:34:31.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6722024-11-27T18:34:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6732024-11-27T18:34:31.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6742024-11-27T18:34:31.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6752024-11-27T18:34:31.626ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.962803ms iteration = 1 status = null
6762024-11-27T18:34:31.630ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6772024-11-27T18:34:31.630ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6782024-11-27T18:34:31.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6792024-11-27T18:34:31.631ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c4e4823-c05b-46d0-bd47-507d26c3e464", "content-length": "476", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6802024-11-27T18:34:31.634ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6812024-11-27T18:34:31.635ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "341b741f-9170-4905-b592-3c5d2ea27295", "content-length": "734", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6822024-11-27T18:34:31.637ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6832024-11-27T18:34:31.638ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af211b8c-3a36-47c5-89c7-1b5b85eae4c4", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6842024-11-27T18:34:31.638ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6852024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0d6b12d-258b-4083-ada7-88bc0eb0ddf3", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6862024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6872024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c16bc9ec-02cb-4fa8-bfa0-57133cdcab8e", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6882024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6892024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "270ad06d-0e37-48e8-8db9-6f362f4f53d7", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6902024-11-27T18:34:31.639ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6912024-11-27T18:34:31.640ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "beebfc56-f60b-4b6e-9f29-d6693599bf72", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6922024-11-27T18:34:31.640ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6932024-11-27T18:34:31.640ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f455ccf-e435-4fc0-9dab-d8d7ecdb02bf", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6942024-11-27T18:34:31.640ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6952024-11-27T18:34:31.643ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16fb527a-af84-4cff-a721-7e49a9b2a4e6", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6962024-11-27T18:34:31.643ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6972024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9826c7c-eb4a-4f74-9216-a74e01a502b9", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6982024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6992024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd892c8-16bc-409e-97de-0874d8c0a603", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7002024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7012024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ede9241-21b5-493a-951b-19381eaf80ed", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7022024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7032024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3e3c41b-9ede-4710-bbc2-03edeae9b390", "content-length": "722", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7042024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7052024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "227b7f0d-7fa5-4b64-850a-3ddcf78eafa3", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7062024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7072024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "58ff3661-2a82-4005-b382-3a65e4ff526f", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7082024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7092024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b79d6f06-c891-434a-a668-5b72a404d8e3", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7102024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7112024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9490ea9d-9619-4afb-a310-25cb54e8163e", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7122024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7132024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e66840-832b-4586-bfc3-071968416e80", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7142024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7152024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fef4db07-a064-40c6-adc1-8d7968bedb5a", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7162024-11-27T18:34:31.650ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7172024-11-27T18:34:31.651ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9676b800-572c-4f02-92cf-8dc685323a98", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7182024-11-27T18:34:31.651ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7192024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "281c663c-da1c-48dc-8764-a2c2265de2e8", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7202024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7212024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "47839f91-f150-4c76-b451-de42b327873e", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7222024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7232024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7301084a-0842-4956-a6be-67d63bd3cb90", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7242024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7252024-11-27T18:34:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7262024-11-27T18:34:31.655ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7272024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7282024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7292024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7302024-11-27T18:34:31.659ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-11-27T18:34:31.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7322024-11-27T18:34:31.661ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7332024-11-27T18:34:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7342024-11-27T18:34:31.666ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7352024-11-27T18:34:31.666ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7362024-11-27T18:34:31.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 276.074153ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7372024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-11-27T18:34:31.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7412024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7432024-11-27T18:34:31.689ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7442024-11-27T18:34:31.689ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7452024-11-27T18:34:31.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 298.980451ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7462024-11-27T18:34:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-11-27T18:34:31.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-11-27T18:34:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-11-27T18:34:31.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7502024-11-27T18:34:31.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512024-11-27T18:34:31.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522024-11-27T18:34:31.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7532024-11-27T18:34:31.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7542024-11-27T18:34:31.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7552024-11-27T18:34:31.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562024-11-27T18:34:31.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572024-11-27T18:34:31.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582024-11-27T18:34:31.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7592024-11-27T18:34:31.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602024-11-27T18:34:31.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612024-11-27T18:34:31.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-11-27T18:34:31.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-11-27T18:34:31.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-27T18:34:31.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-27T18:34:31.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-11-27T18:34:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-11-27T18:34:31.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-11-27T18:34:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692024-11-27T18:34:31.741ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702024-11-27T18:34:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-11-27T18:34:31.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-11-27T18:34:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-11-27T18:34:31.761ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-11-27T18:34:31.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7752024-11-27T18:34:31.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762024-11-27T18:34:31.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772024-11-27T18:34:31.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782024-11-27T18:34:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792024-11-27T18:34:31.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-11-27T18:34:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-11-27T18:34:31.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7822024-11-27T18:34:31.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7832024-11-27T18:34:31.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7842024-11-27T18:34:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7852024-11-27T18:34:31.784ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7862024-11-27T18:34:31.784ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7872024-11-27T18:34:31.784ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7882024-11-27T18:34:31.786ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7892024-11-27T18:34:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7902024-11-27T18:34:31.788ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7912024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7922024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7932024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7942024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962024-11-27T18:34:31.795ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972024-11-27T18:34:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982024-11-27T18:34:31.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7992024-11-27T18:34:31.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8002024-11-27T18:34:31.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012024-11-27T18:34:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022024-11-27T18:34:31.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8032024-11-27T18:34:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8042024-11-27T18:34:31.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052024-11-27T18:34:31.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062024-11-27T18:34:31.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072024-11-27T18:34:31.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082024-11-27T18:34:31.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8092024-11-27T18:34:31.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8102024-11-27T18:34:31.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8112024-11-27T18:34:31.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8122024-11-27T18:34:31.813ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8132024-11-27T18:34:31.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8142024-11-27T18:34:31.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8152024-11-27T18:34:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8162024-11-27T18:34:31.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172024-11-27T18:34:31.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8182024-11-27T18:34:31.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8192024-11-27T18:34:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8202024-11-27T18:34:31.832ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8212024-11-27T18:34:31.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8222024-11-27T18:34:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8232024-11-27T18:34:31.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242024-11-27T18:34:31.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8252024-11-27T18:34:31.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8262024-11-27T18:34:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8272024-11-27T18:34:31.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8282024-11-27T18:34:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8292024-11-27T18:34:31.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302024-11-27T18:34:31.848ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8312024-11-27T18:34:31.848ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8322024-11-27T18:34:31.848ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8332024-11-27T18:34:31.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8342024-11-27T18:34:31.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8352024-11-27T18:34:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8362024-11-27T18:34:31.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-11-27T18:34:31.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8382024-11-27T18:34:31.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8392024-11-27T18:34:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8402024-11-27T18:34:31.918ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 527.565239ms iteration = 1 status = {}
8412024-11-27T18:34:31.972ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8422024-11-27T18:34:31.972ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8432024-11-27T18:34:31.973ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8442024-11-27T18:34:31.974ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8452024-11-27T18:34:31.975ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8462024-11-27T18:34:31.978ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
8472024-11-27T18:34:31.978ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
8482024-11-27T18:34:32.024ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8492024-11-27T18:34:32.024ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8502024-11-27T18:34:32.024ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8512024-11-27T18:34:32.024ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 630.003248ms
8522024-11-27T18:34:32.024ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 633.920585ms iteration = 1 status = {}
8532024-11-27T18:34:32.064ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 75312a92-5758-4131-946f-9c163d729fb7 file = nexus/db-queries/src/db/datastore/inventory.rs:1006
8542024-11-27T18:34:32.064ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 75312a92-5758-4131-946f-9c163d729fb7 time_started = 2024-11-27 18:34:31.628730 UTC
8552024-11-27T18:34:32.064ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 673.231648ms iteration = 1 status = {"collection_id":"75312a92-5758-4131-946f-9c163d729fb7","time_done":"2024-11-27 18:34:31.784881 UTC","time_started":"2024-11-27 18:34:31.628730 UTC"}
8562024-11-27T18:34:32.064ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8572024-11-27T18:34:32.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8582024-11-27T18:34:32.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8592024-11-27T18:34:32.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602024-11-27T18:34:32.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8612024-11-27T18:34:32.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8622024-11-27T18:34:32.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8632024-11-27T18:34:32.075ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
8642024-11-27T18:34:32.075ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 11.642512ms iteration = 2 status = {"error":"rack not yet initialized: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2"}
8652024-11-27T18:34:33.979ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8662024-11-27T18:34:33.980ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8672024-11-27T18:34:33.982ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8682024-11-27T18:34:33.982ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8692024-11-27T18:34:33.984ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8702024-11-27T18:34:33.986ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
8712024-11-27T18:34:33.986ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8722024-11-27T18:34:35.988ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8732024-11-27T18:34:35.988ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8742024-11-27T18:34:35.990ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8752024-11-27T18:34:35.990ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8762024-11-27T18:34:35.992ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8772024-11-27T18:34:35.994ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
8782024-11-27T18:34:35.994ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8792024-11-27T18:34:37.995ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8802024-11-27T18:34:37.996ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8812024-11-27T18:34:37.998ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8822024-11-27T18:34:37.998ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8832024-11-27T18:34:38.000ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8842024-11-27T18:34:38.002ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
8852024-11-27T18:34:38.002ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8862024-11-27T18:34:38.401ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40288
8872024-11-27T18:34:38.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8fa6d6ef-f5ef-485f-84e2-1c66911eadda roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8882024-11-27T18:34:38.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8fa6d6ef-f5ef-485f-84e2-1c66911eadda resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8892024-11-27T18:34:38.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8fa6d6ef-f5ef-485f-84e2-1c66911eadda response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8902024-11-27T18:34:38.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8d57051f-49ab-437c-a243-2db01967ee77 roles = RoleSet { roles: {} } uri = /sled-agents/b844cfb5-ff43-41f6-a61d-f7949f48466b
8912024-11-27T18:34:38.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8d57051f-49ab-437c-a243-2db01967ee77 resource = Database result = Ok(()) uri = /sled-agents/b844cfb5-ff43-41f6-a61d-f7949f48466b
8922024-11-27T18:34:38.418ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" error_message_internal = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 3247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40288 req_id = 8d57051f-49ab-437c-a243-2db01967ee77 response_code = 404 uri = /sled-agents/b844cfb5-ff43-41f6-a61d-f7949f48466b
8932024-11-27T18:34:39.281ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:51666
8942024-11-27T18:34:39.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 187c4cc2-bb80-4301-9fbe-5fb12d587007 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8952024-11-27T18:34:39.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 187c4cc2-bb80-4301-9fbe-5fb12d587007 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8962024-11-27T18:34:39.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 187c4cc2-bb80-4301-9fbe-5fb12d587007 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
8972024-11-27T18:34:40.004ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8982024-11-27T18:34:40.004ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8992024-11-27T18:34:40.006ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9002024-11-27T18:34:40.006ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9012024-11-27T18:34:40.008ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-11-27T18:34:40.010ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
9032024-11-27T18:34:40.010ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9042024-11-27T18:34:40.308ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:56 sled_uuid = b844cfb5-ff43-41f6-a61d-f7949f48466b
9052024-11-27T18:34:40.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75849 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0108962-8a49-4bb7-abbb-3d1447fd4438 response_code = 204 uri = /sled-agents/b844cfb5-ff43-41f6-a61d-f7949f48466b
9062024-11-27T18:34:40.384ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
9072024-11-27T18:34:40.384ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9082024-11-27T18:34:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9092024-11-27T18:34:40.386ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9102024-11-27T18:34:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9112024-11-27T18:34:40.388ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9122024-11-27T18:34:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9132024-11-27T18:34:40.393ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(75312a92-5758-4131-946f-9c163d729fb7, 0), (b845cb2a-c1b0-4e85-86db-5319430db8f0, 0), (13f59999-9c86-4dfc-a124-b6c19f1b3024, 0)]
9142024-11-27T18:34:40.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2114, tv_nsec: 392583306 } })
9152024-11-27T18:34:40.426ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9162024-11-27T18:34:40.426ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9172024-11-27T18:34:40.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9182024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce3b831-f145-44ae-ab78-1eafb13d086a", "content-length": "476", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9192024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9202024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e80bd0f-28e8-4483-814d-55349ed90d21", "content-length": "734", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9212024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9222024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fafa3066-ad80-4298-b0da-851b72bb91c4", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9232024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
9242024-11-27T18:34:40.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db1d3394-80e1-474e-99e0-78bdd07977b7", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9252024-11-27T18:34:40.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
9262024-11-27T18:34:40.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "770ead09-b8a3-4f34-92d0-211c73870bc7", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9272024-11-27T18:34:40.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
9282024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57ef3961-c361-41ec-b0be-0e08450e8e82", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9292024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
9302024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5199f78e-463d-4574-964c-2496c87c7d80", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9312024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
9322024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b9c217b-4ad2-4016-b37f-b9b959e895f0", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9332024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
9342024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f157a9b6-890a-42c4-9e08-8668ffd9403f", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9352024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9362024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a44c06f-4b3e-4456-82ae-415c7794d62c", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9372024-11-27T18:34:40.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9382024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b31b72a6-624c-4570-b2b3-0e3b7c84da3e", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9392024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9402024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "72f1675a-1698-4261-9fb6-ecd897d45822", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9412024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
9422024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "025cc721-dd95-435d-acbd-f69afc88e1b9", "content-length": "722", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9432024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
9442024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b1e98dc-7244-4ea0-9769-1caa0346471e", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9452024-11-27T18:34:40.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
9462024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "04290636-9902-4c50-831e-bb7a794c50ed", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9472024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
9482024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7900706-c331-40cf-be61-2fb370010973", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9492024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
9502024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa325017-150d-48a1-9744-cedd09bdf7f5", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9512024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
9522024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3384d0a-8288-4030-b2ae-965c8962836c", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9532024-11-27T18:34:40.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
9542024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f4cfba-485f-4339-9459-1d3ef2a75817", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9552024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
9562024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2536e40-9e28-483a-8bb7-62d6e8a7868a", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9572024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9582024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4298a4b0-75ab-4d15-9391-4f6fb1863fe7", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9592024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9602024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaa9ad52-67f1-4bf8-b9bb-e27e05281c52", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9612024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9622024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f49252f7-b4bf-409a-b777-7104d7a22ea9", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9632024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9642024-11-27T18:34:40.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9652024-11-27T18:34:40.434ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9662024-11-27T18:34:40.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9672024-11-27T18:34:40.436ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9682024-11-27T18:34:40.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9692024-11-27T18:34:40.438ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9702024-11-27T18:34:40.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9712024-11-27T18:34:40.439ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9722024-11-27T18:34:40.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9732024-11-27T18:34:40.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7698a18b-c3ed-4bc4-b0eb-f5bdb0561858 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9742024-11-27T18:34:40.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7698a18b-c3ed-4bc4-b0eb-f5bdb0561858 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9752024-11-27T18:34:40.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7698a18b-c3ed-4bc4-b0eb-f5bdb0561858 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
9762024-11-27T18:34:40.474ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9772024-11-27T18:34:40.474ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9782024-11-27T18:34:40.669ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee8423f7-8d06-4b85-b7a7-c5f9c22e4862", "content-length": "30783", "date": "Wed, 27 Nov 2024 18:34:40 GMT"} })
9792024-11-27T18:34:40.671ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9802024-11-27T18:34:40.671ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9812024-11-27T18:34:40.671ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9822024-11-27T18:34:40.673ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9832024-11-27T18:34:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9842024-11-27T18:34:40.675ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852024-11-27T18:34:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9862024-11-27T18:34:40.676ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9872024-11-27T18:34:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9882024-11-27T18:34:40.837ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 64504a1c-7931-4bfd-b548-bce7e883eb71 file = nexus/db-queries/src/db/datastore/inventory.rs:1006
9892024-11-27T18:34:40.837ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 64504a1c-7931-4bfd-b548-bce7e883eb71 time_started = 2024-11-27 18:34:40.426603 UTC
9902024-11-27T18:34:40.837ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 453.4022ms iteration = 2 status = {"collection_id":"64504a1c-7931-4bfd-b548-bce7e883eb71","time_done":"2024-11-27 18:34:40.671903 UTC","time_started":"2024-11-27 18:34:40.426603 UTC"}
9912024-11-27T18:34:40.837ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
9922024-11-27T18:34:40.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9932024-11-27T18:34:40.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9942024-11-27T18:34:40.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9952024-11-27T18:34:40.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9962024-11-27T18:34:40.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9972024-11-27T18:34:40.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9982024-11-27T18:34:40.842ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
9992024-11-27T18:34:40.842ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.163337ms iteration = 3 status = {"error":"rack not yet initialized: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2"}
10002024-11-27T18:34:41.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
10012024-11-27T18:34:41.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10022024-11-27T18:34:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10032024-11-27T18:34:41.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
10042024-11-27T18:34:41.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10052024-11-27T18:34:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10062024-11-27T18:34:41.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10072024-11-27T18:34:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10082024-11-27T18:34:41.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10092024-11-27T18:34:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10102024-11-27T18:34:41.397ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
10112024-11-27T18:34:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.823531ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
10122024-11-27T18:34:41.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10132024-11-27T18:34:41.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10142024-11-27T18:34:41.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.322845ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10152024-11-27T18:34:41.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d4121d4-ac89-42f4-bed7-d84944af726c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10162024-11-27T18:34:41.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d4121d4-ac89-42f4-bed7-d84944af726c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10172024-11-27T18:34:41.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d4121d4-ac89-42f4-bed7-d84944af726c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10182024-11-27T18:34:42.011ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10192024-11-27T18:34:42.011ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10202024-11-27T18:34:42.012ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10212024-11-27T18:34:42.012ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10222024-11-27T18:34:42.013ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10232024-11-27T18:34:42.016ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
10242024-11-27T18:34:42.016ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10252024-11-27T18:34:42.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be44d076-5cda-4cc8-80df-0c471bba82bf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10262024-11-27T18:34:42.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be44d076-5cda-4cc8-80df-0c471bba82bf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10272024-11-27T18:34:42.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be44d076-5cda-4cc8-80df-0c471bba82bf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10282024-11-27T18:34:43.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a7d5ae1-8746-4d4f-8f6b-8cafdcbedab4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10292024-11-27T18:34:43.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a7d5ae1-8746-4d4f-8f6b-8cafdcbedab4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10302024-11-27T18:34:43.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a7d5ae1-8746-4d4f-8f6b-8cafdcbedab4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10312024-11-27T18:34:44.017ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10322024-11-27T18:34:44.017ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10332024-11-27T18:34:44.019ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10342024-11-27T18:34:44.019ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10352024-11-27T18:34:44.021ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-11-27T18:34:44.023ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
10372024-11-27T18:34:44.023ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10382024-11-27T18:34:44.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a9b1651-22de-40a9-bbae-e4322dae5ce2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10392024-11-27T18:34:44.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a9b1651-22de-40a9-bbae-e4322dae5ce2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10402024-11-27T18:34:44.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a9b1651-22de-40a9-bbae-e4322dae5ce2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10412024-11-27T18:34:45.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0d07c9e2-5c88-4a85-805c-00890959fda2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10422024-11-27T18:34:45.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0d07c9e2-5c88-4a85-805c-00890959fda2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10432024-11-27T18:34:45.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0d07c9e2-5c88-4a85-805c-00890959fda2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
10442024-11-27T18:34:46.024ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10452024-11-27T18:34:46.024ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10462024-11-27T18:34:46.026ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10472024-11-27T18:34:46.026ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10482024-11-27T18:34:46.027ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10492024-11-27T18:34:46.030ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
10502024-11-27T18:34:46.030ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
10512024-11-27T18:34:46.030ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10522024-11-27T18:34:46.030ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10532024-11-27T18:34:46.032ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10542024-11-27T18:34:46.032ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10552024-11-27T18:34:46.033ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10562024-11-27T18:34:46.033ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10572024-11-27T18:34:46.035ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10582024-11-27T18:34:46.035ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10592024-11-27T18:34:46.036ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10602024-11-27T18:34:46.036ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10612024-11-27T18:34:46.037ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10622024-11-27T18:34:46.038ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10632024-11-27T18:34:46.039ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642024-11-27T18:34:46.042ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10652024-11-27T18:34:46.042ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10662024-11-27T18:34:46.042ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10672024-11-27T18:34:46.043ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10682024-11-27T18:34:46.043ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10692024-11-27T18:34:46.045ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10702024-11-27T18:34:46.045ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10712024-11-27T18:34:46.046ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722024-11-27T18:34:46.049ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10732024-11-27T18:34:46.049ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10742024-11-27T18:34:46.049ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10752024-11-27T18:34:46.051ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10762024-11-27T18:34:46.052ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10772024-11-27T18:34:46.053ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10782024-11-27T18:34:46.053ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10792024-11-27T18:34:46.054ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10802024-11-27T18:34:46.054ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10812024-11-27T18:34:46.055ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10822024-11-27T18:34:46.056ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10832024-11-27T18:34:46.057ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10842024-11-27T18:34:46.057ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10852024-11-27T18:34:46.058ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10862024-11-27T18:34:46.058ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10872024-11-27T18:34:46.059ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882024-11-27T18:34:46.062ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10892024-11-27T18:34:46.062ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10902024-11-27T18:34:46.062ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10912024-11-27T18:34:46.063ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10922024-11-27T18:34:46.063ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10932024-11-27T18:34:46.065ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10942024-11-27T18:34:46.065ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10952024-11-27T18:34:46.066ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10962024-11-27T18:34:46.067ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10972024-11-27T18:34:46.171ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10982024-11-27T18:34:46.171ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10992024-11-27T18:34:46.173ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11002024-11-27T18:34:46.173ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11012024-11-27T18:34:46.174ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11022024-11-27T18:34:46.174ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11032024-11-27T18:34:46.176ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11042024-11-27T18:34:46.179ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11052024-11-27T18:34:46.179ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11062024-11-27T18:34:46.179ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11072024-11-27T18:34:46.181ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11082024-11-27T18:34:46.181ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11092024-11-27T18:34:46.182ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11102024-11-27T18:34:46.183ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11112024-11-27T18:34:46.184ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122024-11-27T18:34:46.187ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11132024-11-27T18:34:46.187ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11142024-11-27T18:34:46.187ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11152024-11-27T18:34:46.191ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11162024-11-27T18:34:46.191ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11172024-11-27T18:34:46.193ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11182024-11-27T18:34:46.193ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11192024-11-27T18:34:46.195ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11202024-11-27T18:34:46.195ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11212024-11-27T18:34:46.197ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11222024-11-27T18:34:46.197ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11232024-11-27T18:34:46.302ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11242024-11-27T18:34:46.302ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11252024-11-27T18:34:46.304ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11262024-11-27T18:34:46.304ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11272024-11-27T18:34:46.305ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11282024-11-27T18:34:46.305ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11292024-11-27T18:34:46.307ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-11-27T18:34:46.310ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11312024-11-27T18:34:46.310ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11322024-11-27T18:34:46.310ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11332024-11-27T18:34:46.312ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11342024-11-27T18:34:46.312ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11352024-11-27T18:34:46.313ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11362024-11-27T18:34:46.314ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11372024-11-27T18:34:46.315ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11382024-11-27T18:34:46.318ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11392024-11-27T18:34:46.318ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11402024-11-27T18:34:46.318ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11412024-11-27T18:34:46.435ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
11422024-11-27T18:34:46.435ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11432024-11-27T18:34:46.435ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11442024-11-27T18:34:46.436ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-11-27T18:34:46.438ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
11462024-11-27T18:34:46.438ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11472024-11-27T18:34:46.438ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11482024-11-27T18:34:46.439ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
11492024-11-27T18:34:46.442ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
11502024-11-27T18:34:46.442ZDEBGnexus (InternalApi): resolved 2 rules for sleds
11512024-11-27T18:34:46.462ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
11522024-11-27T18:34:46.463ZDEBGnexus (InternalApi): sending firewall rules to sled agents
11532024-11-27T18:34:46.463ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11542024-11-27T18:34:46.463ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11552024-11-27T18:34:46.467ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11562024-11-27T18:34:46.467ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11572024-11-27T18:34:46.469ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11582024-11-27T18:34:46.471ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
11592024-11-27T18:34:46.502ZDEBGnexus (InternalApi): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
11602024-11-27T18:34:46.503ZDEBGnexus (InternalApi): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8006d7ae-b31d-404e-902f-5d95a1e73187", "date": "Wed, 27 Nov 2024 18:34:46 GMT"} })
11612024-11-27T18:34:46.504ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
11622024-11-27T18:34:46.504ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
11632024-11-27T18:34:46.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cbf4b75-2d28-453c-b85d-028db2ad758f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11642024-11-27T18:34:46.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cbf4b75-2d28-453c-b85d-028db2ad758f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11652024-11-27T18:34:46.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3cbf4b75-2d28-453c-b85d-028db2ad758f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11662024-11-27T18:34:47.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 036344de-505f-4583-b28f-852de4ac6474 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11672024-11-27T18:34:47.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 036344de-505f-4583-b28f-852de4ac6474 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11682024-11-27T18:34:47.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 036344de-505f-4583-b28f-852de4ac6474 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11692024-11-27T18:34:48.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8ed43e8-4264-47fd-b39d-5ce589b3323f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11702024-11-27T18:34:48.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8ed43e8-4264-47fd-b39d-5ce589b3323f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11712024-11-27T18:34:48.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b8ed43e8-4264-47fd-b39d-5ce589b3323f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11722024-11-27T18:34:49.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 979c239e-7728-4ee8-9fd9-49951fffeafb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11732024-11-27T18:34:49.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 979c239e-7728-4ee8-9fd9-49951fffeafb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11742024-11-27T18:34:49.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 979c239e-7728-4ee8-9fd9-49951fffeafb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11752024-11-27T18:34:50.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a89605d-d0b8-4890-ba5d-4ca23c8a7b8b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11762024-11-27T18:34:50.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a89605d-d0b8-4890-ba5d-4ca23c8a7b8b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11772024-11-27T18:34:50.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a89605d-d0b8-4890-ba5d-4ca23c8a7b8b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
11782024-11-27T18:34:51.389ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
11792024-11-27T18:34:51.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11802024-11-27T18:34:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11812024-11-27T18:34:51.390ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
11822024-11-27T18:34:51.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11832024-11-27T18:34:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11842024-11-27T18:34:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-11-27T18:34:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11862024-11-27T18:34:51.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11872024-11-27T18:34:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11882024-11-27T18:34:51.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11892024-11-27T18:34:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11902024-11-27T18:34:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912024-11-27T18:34:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
11922024-11-27T18:34:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11932024-11-27T18:34:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11942024-11-27T18:34:51.415ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
11952024-11-27T18:34:51.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.949465ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z","time_found":"2024-11-27T18:34:51.415857182Z"}
11962024-11-27T18:34:51.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
11972024-11-27T18:34:51.415ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
11982024-11-27T18:34:51.415ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
11992024-11-27T18:34:51.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.46\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
12002024-11-27T18:34:51.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12012024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12022024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12032024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12042024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12052024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12062024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12072024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12082024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12092024-11-27T18:34:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12102024-11-27T18:34:51.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112024-11-27T18:34:51.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12122024-11-27T18:34:51.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12132024-11-27T18:34:51.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12142024-11-27T18:34:51.420ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12152024-11-27T18:34:51.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12162024-11-27T18:34:51.420ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12172024-11-27T18:34:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12182024-11-27T18:34:51.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12192024-11-27T18:34:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12202024-11-27T18:34:51.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212024-11-27T18:34:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12222024-11-27T18:34:51.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12232024-11-27T18:34:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12242024-11-27T18:34:51.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-11-27T18:34:51.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12262024-11-27T18:34:51.425ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12272024-11-27T18:34:51.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12282024-11-27T18:34:51.426ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292024-11-27T18:34:51.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12302024-11-27T18:34:51.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12312024-11-27T18:34:51.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12322024-11-27T18:34:51.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.963774ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12332024-11-27T18:34:51.459ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
12342024-11-27T18:34:51.491ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
12352024-11-27T18:34:51.523ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12362024-11-27T18:34:51.555ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
12372024-11-27T18:34:51.590ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
12382024-11-27T18:34:51.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12775946-c62e-4be6-a41d-b6cd37e56d10 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12392024-11-27T18:34:51.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12775946-c62e-4be6-a41d-b6cd37e56d10 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12402024-11-27T18:34:51.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12775946-c62e-4be6-a41d-b6cd37e56d10 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12412024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7faf03ed-0feb-4a74-a482-8959dbf27ec3", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:51 GMT"} })
12422024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12432024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12442024-11-27T18:34:52.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452024-11-27T18:34:52.526ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12462024-11-27T18:34:52.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12472024-11-27T18:34:52.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12482024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5535bab7-4946-4d68-b904-9a9a133cffce", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:51 GMT"} })
12492024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12502024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12512024-11-27T18:34:52.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12522024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12532024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12542024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12552024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b76c57-b31a-4539-8051-cc6a278bd4ea", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
12562024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12572024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12582024-11-27T18:34:52.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12602024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12612024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12622024-11-27T18:34:52.621ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "359e3545-c3a9-42ad-8f4d-3e94eb36e0af", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:51 GMT"} })
12632024-11-27T18:34:52.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12642024-11-27T18:34:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12652024-11-27T18:34:52.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12662024-11-27T18:34:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12672024-11-27T18:34:52.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12682024-11-27T18:34:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12692024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76433954-83b2-4bc0-9ad6-4d313f4d0bca", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:51 GMT"} })
12702024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12712024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12722024-11-27T18:34:52.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732024-11-27T18:34:52.639ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12742024-11-27T18:34:52.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12752024-11-27T18:34:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12762024-11-27T18:34:52.646ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.230235585s iteration = 2 status = {"nsuccess":5}
12772024-11-27T18:34:52.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26fc2690-a218-4c0b-ac5a-ab7980bcf1ff roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12782024-11-27T18:34:52.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26fc2690-a218-4c0b-ac5a-ab7980bcf1ff resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12792024-11-27T18:34:52.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 26fc2690-a218-4c0b-ac5a-ab7980bcf1ff response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12802024-11-27T18:34:53.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b08db0d7-b44e-4a38-a024-213b087ec1d4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12812024-11-27T18:34:53.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b08db0d7-b44e-4a38-a024-213b087ec1d4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12822024-11-27T18:34:53.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b08db0d7-b44e-4a38-a024-213b087ec1d4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12832024-11-27T18:34:54.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61b56d57-0c91-40ca-ae44-3035662d2e63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12842024-11-27T18:34:54.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61b56d57-0c91-40ca-ae44-3035662d2e63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12852024-11-27T18:34:54.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61b56d57-0c91-40ca-ae44-3035662d2e63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
12862024-11-27T18:34:55.031ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44726
12872024-11-27T18:34:55.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 36ff9c88-f211-4a35-8c1a-75cc9371881b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12882024-11-27T18:34:55.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 36ff9c88-f211-4a35-8c1a-75cc9371881b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12892024-11-27T18:34:55.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 36ff9c88-f211-4a35-8c1a-75cc9371881b response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12902024-11-27T18:34:55.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ecdc3230-86d4-4658-9445-e096a6b3b4fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12912024-11-27T18:34:55.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ecdc3230-86d4-4658-9445-e096a6b3b4fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12922024-11-27T18:34:55.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ecdc3230-86d4-4658-9445-e096a6b3b4fa response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12932024-11-27T18:34:55.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = a900f9bf-7f8c-4982-a909-4314f43e5f42 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12942024-11-27T18:34:55.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = a900f9bf-7f8c-4982-a909-4314f43e5f42 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12952024-11-27T18:34:55.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = a900f9bf-7f8c-4982-a909-4314f43e5f42 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12962024-11-27T18:34:55.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1479d988-1180-4e39-b139-f70e9b422f34 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12972024-11-27T18:34:55.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1479d988-1180-4e39-b139-f70e9b422f34 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12982024-11-27T18:34:55.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 1479d988-1180-4e39-b139-f70e9b422f34 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12992024-11-27T18:34:55.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ee184c0e-7858-44a0-a49e-98e078d1f13a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13002024-11-27T18:34:55.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ee184c0e-7858-44a0-a49e-98e078d1f13a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13012024-11-27T18:34:55.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ee184c0e-7858-44a0-a49e-98e078d1f13a response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13022024-11-27T18:34:55.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c58de894-c97e-4825-bb76-9d3ac779e424 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13032024-11-27T18:34:55.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c58de894-c97e-4825-bb76-9d3ac779e424 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13042024-11-27T18:34:55.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c58de894-c97e-4825-bb76-9d3ac779e424 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13052024-11-27T18:34:55.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b8a122c8-8dee-4d73-9f9d-f42c7fa9ebde roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13062024-11-27T18:34:55.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b8a122c8-8dee-4d73-9f9d-f42c7fa9ebde resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13072024-11-27T18:34:55.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b8a122c8-8dee-4d73-9f9d-f42c7fa9ebde response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13082024-11-27T18:34:55.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 8e33bd69-0cba-4190-b5d7-f7beba91fd98 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13092024-11-27T18:34:55.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 8e33bd69-0cba-4190-b5d7-f7beba91fd98 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13102024-11-27T18:34:55.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 8e33bd69-0cba-4190-b5d7-f7beba91fd98 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13112024-11-27T18:34:55.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 82c0af46-281f-4bf2-8fe9-208f20d7ff91 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13122024-11-27T18:34:55.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 82c0af46-281f-4bf2-8fe9-208f20d7ff91 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13132024-11-27T18:34:55.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 82c0af46-281f-4bf2-8fe9-208f20d7ff91 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13142024-11-27T18:34:55.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5045fc00-6025-4761-926d-588cd9ed822d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13152024-11-27T18:34:55.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5045fc00-6025-4761-926d-588cd9ed822d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13162024-11-27T18:34:55.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5045fc00-6025-4761-926d-588cd9ed822d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13172024-11-27T18:34:56.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 9a995181-e502-409d-baa2-d3b3cd0b696c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13182024-11-27T18:34:56.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 9a995181-e502-409d-baa2-d3b3cd0b696c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13192024-11-27T18:34:56.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 9a995181-e502-409d-baa2-d3b3cd0b696c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13202024-11-27T18:34:56.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9986f42e-d90c-4223-8942-4c754fdd7647 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13212024-11-27T18:34:56.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9986f42e-d90c-4223-8942-4c754fdd7647 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13222024-11-27T18:34:56.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9986f42e-d90c-4223-8942-4c754fdd7647 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13232024-11-27T18:34:57.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f01dc17e-1999-44ae-a564-462bd1deab8d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13242024-11-27T18:34:57.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f01dc17e-1999-44ae-a564-462bd1deab8d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13252024-11-27T18:34:57.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f01dc17e-1999-44ae-a564-462bd1deab8d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13262024-11-27T18:34:58.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aaa9c4a6-7387-4e70-b343-b544d8b81e76 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13272024-11-27T18:34:58.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aaa9c4a6-7387-4e70-b343-b544d8b81e76 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13282024-11-27T18:34:58.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aaa9c4a6-7387-4e70-b343-b544d8b81e76 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13292024-11-27T18:34:59.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66dc6702-da92-4527-afea-eb56fde92816 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13302024-11-27T18:34:59.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66dc6702-da92-4527-afea-eb56fde92816 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13312024-11-27T18:34:59.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66dc6702-da92-4527-afea-eb56fde92816 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13322024-11-27T18:35:00.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a0ed33a-be1f-4f03-8041-d724a3995cfa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13332024-11-27T18:35:00.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a0ed33a-be1f-4f03-8041-d724a3995cfa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13342024-11-27T18:35:00.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a0ed33a-be1f-4f03-8041-d724a3995cfa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
13352024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
13362024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
13372024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13382024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13392024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
13402024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
13412024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13422024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13432024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
13442024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
13452024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13462024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13472024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
13482024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13492024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
13502024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13512024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13522024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
13532024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
13542024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
13552024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13562024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13572024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
13582024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
13592024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
13602024-11-27T18:35:01.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13612024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13622024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13632024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13642024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13652024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13662024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13672024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13682024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13692024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13702024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13712024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13722024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13732024-11-27T18:35:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13742024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13752024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13762024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13772024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
13782024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
13792024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13802024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
13812024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13822024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13832024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13842024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13852024-11-27T18:35:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13862024-11-27T18:35:01.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-11-27T18:35:01.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-11-27T18:35:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.720621ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13892024-11-27T18:35:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13902024-11-27T18:35:01.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13912024-11-27T18:35:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13922024-11-27T18:35:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13932024-11-27T18:35:01.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13942024-11-27T18:35:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13952024-11-27T18:35:01.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 396927552 } })
13962024-11-27T18:35:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-11-27T18:35:01.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-11-27T18:35:01.398ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13992024-11-27T18:35:01.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14012024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14022024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14032024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14042024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14052024-11-27T18:35:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14062024-11-27T18:35:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14072024-11-27T18:35:01.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14082024-11-27T18:35:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14092024-11-27T18:35:01.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102024-11-27T18:35:01.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 402385213 } })
14112024-11-27T18:35:01.404ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14122024-11-27T18:35:01.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14132024-11-27T18:35:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14142024-11-27T18:35:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14152024-11-27T18:35:01.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14162024-11-27T18:35:01.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14172024-11-27T18:35:01.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14182024-11-27T18:35:01.410ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 408450653 } })
14192024-11-27T18:35:01.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14202024-11-27T18:35:01.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14212024-11-27T18:35:01.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14222024-11-27T18:35:01.410ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
14232024-11-27T18:35:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14242024-11-27T18:35:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14252024-11-27T18:35:01.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.308128ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
14262024-11-27T18:35:01.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14272024-11-27T18:35:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14282024-11-27T18:35:01.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14292024-11-27T18:35:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14302024-11-27T18:35:01.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.368311ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
14312024-11-27T18:35:01.443ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14322024-11-27T18:35:01.443ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14332024-11-27T18:35:01.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14342024-11-27T18:35:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14352024-11-27T18:35:01.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14362024-11-27T18:35:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14372024-11-27T18:35:01.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14382024-11-27T18:35:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14392024-11-27T18:35:01.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14402024-11-27T18:35:01.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14412024-11-27T18:35:01.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14422024-11-27T18:35:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14432024-11-27T18:35:01.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-11-27T18:35:01.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.40907ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14452024-11-27T18:35:01.453ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14462024-11-27T18:35:01.453ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.0308ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14472024-11-27T18:35:01.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
14482024-11-27T18:35:01.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14492024-11-27T18:35:01.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14502024-11-27T18:35:01.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.626736ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14512024-11-27T18:35:01.470ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14522024-11-27T18:35:01.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14532024-11-27T18:35:01.471ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
14542024-11-27T18:35:01.471ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.083932ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
14552024-11-27T18:35:01.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14562024-11-27T18:35:01.474ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14572024-11-27T18:35:01.475ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e15f294c-93dd-48b3-889f-0bdac9297a24", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
14582024-11-27T18:35:01.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14592024-11-27T18:35:01.476ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14602024-11-27T18:35:01.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.616784ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14612024-11-27T18:35:01.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622024-11-27T18:35:01.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
14632024-11-27T18:35:01.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14642024-11-27T18:35:01.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14652024-11-27T18:35:01.488ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14662024-11-27T18:35:01.488ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14672024-11-27T18:35:01.488ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14682024-11-27T18:35:01.488ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14692024-11-27T18:35:01.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14702024-11-27T18:35:01.488ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "170ad29c-f4d3-4996-8a0f-a7bc8e77e85f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
14712024-11-27T18:35:01.488ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14722024-11-27T18:35:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14732024-11-27T18:35:01.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14742024-11-27T18:35:01.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14752024-11-27T18:35:01.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14762024-11-27T18:35:01.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.157957ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14772024-11-27T18:35:01.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14782024-11-27T18:35:01.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14792024-11-27T18:35:01.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
14802024-11-27T18:35:01.506ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14812024-11-27T18:35:01.506ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18cfdbf7-82e0-47b2-ad85-98eb1539646c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
14822024-11-27T18:35:01.506ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14832024-11-27T18:35:01.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
14842024-11-27T18:35:01.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14852024-11-27T18:35:01.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14862024-11-27T18:35:01.545ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14872024-11-27T18:35:01.545ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14882024-11-27T18:35:01.545ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 155.059049ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14892024-11-27T18:35:01.579ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 189.483979ms iteration = 2 status = {}
14902024-11-27T18:35:01.586ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14912024-11-27T18:35:01.586ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14922024-11-27T18:35:01.586ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb53123d-fc78-469f-958e-7c36e0ddf791", "content-length": "372", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
14932024-11-27T18:35:01.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14942024-11-27T18:35:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14952024-11-27T18:35:01.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962024-11-27T18:35:01.590ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14972024-11-27T18:35:01.591ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "95f96494-f577-48dd-8645-b34a05732786", "content-length": "1", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
14982024-11-27T18:35:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14992024-11-27T18:35:01.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15002024-11-27T18:35:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15012024-11-27T18:35:01.592ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15022024-11-27T18:35:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15032024-11-27T18:35:01.595ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.503947ms iteration = 2 status = null
15042024-11-27T18:35:01.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15052024-11-27T18:35:01.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15062024-11-27T18:35:01.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15072024-11-27T18:35:01.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15082024-11-27T18:35:01.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15092024-11-27T18:35:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15102024-11-27T18:35:01.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15112024-11-27T18:35:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15122024-11-27T18:35:01.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15132024-11-27T18:35:01.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15142024-11-27T18:35:01.656ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.109184ms iteration = 4 status = {"physical_disks_added":0}
15152024-11-27T18:35:01.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15162024-11-27T18:35:01.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15172024-11-27T18:35:01.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15182024-11-27T18:35:01.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15192024-11-27T18:35:01.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15202024-11-27T18:35:01.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15212024-11-27T18:35:01.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-11-27T18:35:01.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15232024-11-27T18:35:01.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15242024-11-27T18:35:01.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15252024-11-27T18:35:01.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15262024-11-27T18:35:01.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15272024-11-27T18:35:01.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15282024-11-27T18:35:01.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15292024-11-27T18:35:01.671ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15302024-11-27T18:35:01.671ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15312024-11-27T18:35:01.671ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c4bc398f-ec83-48ca-8407-2fcaea66800d", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15322024-11-27T18:35:01.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15332024-11-27T18:35:01.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 670107151 } })
15342024-11-27T18:35:01.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15352024-11-27T18:35:01.672ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
15362024-11-27T18:35:01.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15372024-11-27T18:35:01.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15382024-11-27T18:35:01.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15392024-11-27T18:35:01.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15402024-11-27T18:35:01.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15412024-11-27T18:35:01.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15422024-11-27T18:35:01.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15432024-11-27T18:35:01.739ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15442024-11-27T18:35:01.740ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "521c89f6-4738-4566-a60f-e512261444c4", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15452024-11-27T18:35:01.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15462024-11-27T18:35:01.740ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15472024-11-27T18:35:01.740ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c5b1cac-6336-4d76-a4de-bd2df21bfe10", "content-length": "691", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15482024-11-27T18:35:01.740ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15492024-11-27T18:35:01.740ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15502024-11-27T18:35:01.740ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15512024-11-27T18:35:01.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15522024-11-27T18:35:01.742ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.697253ms iteration = 2 status = {}
15532024-11-27T18:35:01.742ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
15542024-11-27T18:35:01.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15552024-11-27T18:35:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15562024-11-27T18:35:01.744ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15572024-11-27T18:35:01.748ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15582024-11-27T18:35:01.748ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2f418c2d-4661-4545-9df0-63a6a0996ec7", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15592024-11-27T18:35:01.749ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.324746ms iteration = 2 status = {}
15602024-11-27T18:35:01.757ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15612024-11-27T18:35:01.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e76653b-098f-4ac1-aacc-7df10c23bae2", "content-length": "134", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15622024-11-27T18:35:01.761ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15632024-11-27T18:35:01.761ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
15642024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15652024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15662024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15672024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15682024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15692024-11-27T18:35:01.762ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15702024-11-27T18:35:01.765ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15712024-11-27T18:35:01.765ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15722024-11-27T18:35:01.766ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
15732024-11-27T18:35:01.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15742024-11-27T18:35:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15752024-11-27T18:35:01.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15762024-11-27T18:35:01.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "700910b5-581a-4429-9c56-724ac3369152", "content-length": "2", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15772024-11-27T18:35:01.771ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15782024-11-27T18:35:01.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7797e35-5ed8-4f5e-9289-892fb1704080", "content-length": "52", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15792024-11-27T18:35:01.771ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
15802024-11-27T18:35:01.771ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15812024-11-27T18:35:01.772ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
15822024-11-27T18:35:01.772ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e59b84-f738-4c6a-bd03-1c0f0ee7dd08", "content-length": "4", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15832024-11-27T18:35:01.773ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 383.27878ms iteration = 2 status = 6
15842024-11-27T18:35:01.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c57142e-57a0-42f7-b382-75fda8c16ef9", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15852024-11-27T18:35:01.899ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
15862024-11-27T18:35:01.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15872024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a448a932-314a-4f8f-bbd2-75b03ae51f0f", "content-length": "539", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
15882024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15892024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15902024-11-27T18:35:01.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15912024-11-27T18:35:01.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15922024-11-27T18:35:01.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 443e5945-e2b0-4e78-9066-9b5456a7ecb9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15932024-11-27T18:35:01.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 443e5945-e2b0-4e78-9066-9b5456a7ecb9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15942024-11-27T18:35:01.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15952024-11-27T18:35:01.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15962024-11-27T18:35:01.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 443e5945-e2b0-4e78-9066-9b5456a7ecb9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
15972024-11-27T18:35:01.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15982024-11-27T18:35:01.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15992024-11-27T18:35:01.924ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
16002024-11-27T18:35:01.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16012024-11-27T18:35:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16022024-11-27T18:35:01.928ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
16032024-11-27T18:35:01.930ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16042024-11-27T18:35:01.936ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "e681fab3-25cb-40d9-89c3-cdb8a705cfaa", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
16052024-11-27T18:35:01.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16062024-11-27T18:35:01.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16072024-11-27T18:35:01.950ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 560.531168ms iteration = 2 status = {}
16082024-11-27T18:35:02.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 66e4727a-356a-43e1-9f34-b40ef0383dfd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
16092024-11-27T18:35:02.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 66e4727a-356a-43e1-9f34-b40ef0383dfd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
16102024-11-27T18:35:02.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 66e4727a-356a-43e1-9f34-b40ef0383dfd response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
16112024-11-27T18:35:02.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3f1d39f0-c109-48ff-aae8-99276b172bea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
16122024-11-27T18:35:02.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3f1d39f0-c109-48ff-aae8-99276b172bea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
16132024-11-27T18:35:02.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3f1d39f0-c109-48ff-aae8-99276b172bea response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
16142024-11-27T18:35:02.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d6ab1-3b09-4232-bca9-e37e019f8640 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16152024-11-27T18:35:02.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d6ab1-3b09-4232-bca9-e37e019f8640 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16162024-11-27T18:35:02.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 996d6ab1-3b09-4232-bca9-e37e019f8640 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16172024-11-27T18:35:03.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf0c57ea-027d-434b-b9de-5df7439d8923 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16182024-11-27T18:35:03.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf0c57ea-027d-434b-b9de-5df7439d8923 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16192024-11-27T18:35:03.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cf0c57ea-027d-434b-b9de-5df7439d8923 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16202024-11-27T18:35:04.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc2977a9-9c05-4d1d-a6e8-a56ead12daed roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16212024-11-27T18:35:04.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc2977a9-9c05-4d1d-a6e8-a56ead12daed resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16222024-11-27T18:35:04.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc2977a9-9c05-4d1d-a6e8-a56ead12daed response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16232024-11-27T18:35:06.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ac8f81c-7f0d-4568-98f7-649f87e3deb8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16242024-11-27T18:35:06.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ac8f81c-7f0d-4568-98f7-649f87e3deb8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16252024-11-27T18:35:06.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ac8f81c-7f0d-4568-98f7-649f87e3deb8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16262024-11-27T18:35:07.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06375179-35fa-4fe0-aa14-da7aa9ac8eba roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16272024-11-27T18:35:07.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06375179-35fa-4fe0-aa14-da7aa9ac8eba resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16282024-11-27T18:35:07.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06375179-35fa-4fe0-aa14-da7aa9ac8eba response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16292024-11-27T18:35:08.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bb228c25-2cac-4cad-a579-cbefe42b42a4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16302024-11-27T18:35:08.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bb228c25-2cac-4cad-a579-cbefe42b42a4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16312024-11-27T18:35:08.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bb228c25-2cac-4cad-a579-cbefe42b42a4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16322024-11-27T18:35:09.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a32cceb1-3028-4dfc-830f-13fbbbc602a6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16332024-11-27T18:35:09.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a32cceb1-3028-4dfc-830f-13fbbbc602a6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16342024-11-27T18:35:09.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a32cceb1-3028-4dfc-830f-13fbbbc602a6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16352024-11-27T18:35:10.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 63a78f78-2c92-46dc-b40e-968cebdbef19 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16362024-11-27T18:35:10.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 63a78f78-2c92-46dc-b40e-968cebdbef19 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16372024-11-27T18:35:10.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 63a78f78-2c92-46dc-b40e-968cebdbef19 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16382024-11-27T18:35:11.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51c2787e-44f4-410b-87a9-1f0998457238 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16392024-11-27T18:35:11.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51c2787e-44f4-410b-87a9-1f0998457238 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16402024-11-27T18:35:11.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51c2787e-44f4-410b-87a9-1f0998457238 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16412024-11-27T18:35:11.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
16422024-11-27T18:35:11.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16432024-11-27T18:35:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16442024-11-27T18:35:11.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
16452024-11-27T18:35:11.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16462024-11-27T18:35:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16472024-11-27T18:35:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16482024-11-27T18:35:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16492024-11-27T18:35:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16502024-11-27T18:35:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16512024-11-27T18:35:11.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16522024-11-27T18:35:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16532024-11-27T18:35:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.578988ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16542024-11-27T18:35:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16552024-11-27T18:35:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562024-11-27T18:35:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-11-27T18:35:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
16582024-11-27T18:35:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16592024-11-27T18:35:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16602024-11-27T18:35:11.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
16612024-11-27T18:35:11.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.591895ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
16622024-11-27T18:35:12.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d02d3541-aeb9-4bfa-95ef-e55c93f19586 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16632024-11-27T18:35:12.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d02d3541-aeb9-4bfa-95ef-e55c93f19586 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16642024-11-27T18:35:12.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d02d3541-aeb9-4bfa-95ef-e55c93f19586 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16652024-11-27T18:35:13.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b655c79-06a5-435d-b853-70c81281c3ca roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16662024-11-27T18:35:13.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b655c79-06a5-435d-b853-70c81281c3ca resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16672024-11-27T18:35:13.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b655c79-06a5-435d-b853-70c81281c3ca response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16682024-11-27T18:35:13.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3e2dce1b-140c-4644-94dc-1a538c005110 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
16692024-11-27T18:35:13.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3e2dce1b-140c-4644-94dc-1a538c005110 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
16702024-11-27T18:35:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3e2dce1b-140c-4644-94dc-1a538c005110 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
16712024-11-27T18:35:13.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 65603e80-63a0-4a7e-bd2a-a7fec91574d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
16722024-11-27T18:35:13.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 65603e80-63a0-4a7e-bd2a-a7fec91574d3 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
16732024-11-27T18:35:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 65603e80-63a0-4a7e-bd2a-a7fec91574d3 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
16742024-11-27T18:35:14.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e303264-a9a0-4ba3-b0ee-8092c0407c59 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16752024-11-27T18:35:14.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e303264-a9a0-4ba3-b0ee-8092c0407c59 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16762024-11-27T18:35:14.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e303264-a9a0-4ba3-b0ee-8092c0407c59 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16772024-11-27T18:35:15.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fb043e-3a98-40e3-b9fb-5c6d39292bf8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16782024-11-27T18:35:15.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fb043e-3a98-40e3-b9fb-5c6d39292bf8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16792024-11-27T18:35:15.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fb043e-3a98-40e3-b9fb-5c6d39292bf8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16802024-11-27T18:35:16.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3ab13ed-5220-4eb5-a294-930467ffc3f5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16812024-11-27T18:35:16.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3ab13ed-5220-4eb5-a294-930467ffc3f5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16822024-11-27T18:35:16.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3ab13ed-5220-4eb5-a294-930467ffc3f5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16832024-11-27T18:35:17.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 147811a3-f9da-4f32-83b0-f3c7244fd2a4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16842024-11-27T18:35:17.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 147811a3-f9da-4f32-83b0-f3c7244fd2a4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16852024-11-27T18:35:17.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 147811a3-f9da-4f32-83b0-f3c7244fd2a4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16862024-11-27T18:35:18.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 18151410-ff1f-4f9e-a736-0536eef581fa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16872024-11-27T18:35:18.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 18151410-ff1f-4f9e-a736-0536eef581fa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16882024-11-27T18:35:18.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 18151410-ff1f-4f9e-a736-0536eef581fa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16892024-11-27T18:35:19.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9322bc5f-acfd-453d-a919-9627d97e3040 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16902024-11-27T18:35:19.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9322bc5f-acfd-453d-a919-9627d97e3040 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16912024-11-27T18:35:19.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9322bc5f-acfd-453d-a919-9627d97e3040 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16922024-11-27T18:35:20.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad56b627-6ee0-467b-bb42-8aff5fad1226 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16932024-11-27T18:35:20.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad56b627-6ee0-467b-bb42-8aff5fad1226 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16942024-11-27T18:35:20.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad56b627-6ee0-467b-bb42-8aff5fad1226 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16952024-11-27T18:35:21.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5aea9af1-29fb-42d8-9a14-cef254c75676 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16962024-11-27T18:35:21.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5aea9af1-29fb-42d8-9a14-cef254c75676 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16972024-11-27T18:35:21.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5aea9af1-29fb-42d8-9a14-cef254c75676 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
16982024-11-27T18:35:21.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
16992024-11-27T18:35:21.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17002024-11-27T18:35:21.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17012024-11-27T18:35:21.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
17022024-11-27T18:35:21.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17032024-11-27T18:35:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17042024-11-27T18:35:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17052024-11-27T18:35:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17062024-11-27T18:35:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17072024-11-27T18:35:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.00215ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17082024-11-27T18:35:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17092024-11-27T18:35:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17102024-11-27T18:35:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17112024-11-27T18:35:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17122024-11-27T18:35:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17132024-11-27T18:35:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-11-27T18:35:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
17152024-11-27T18:35:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17162024-11-27T18:35:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17172024-11-27T18:35:21.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
17182024-11-27T18:35:21.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.376996ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
17192024-11-27T18:35:22.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ec3aed-35bc-416a-945d-0ee62aa2bfca roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17202024-11-27T18:35:22.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ec3aed-35bc-416a-945d-0ee62aa2bfca resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17212024-11-27T18:35:22.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ec3aed-35bc-416a-945d-0ee62aa2bfca response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17222024-11-27T18:35:23.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e830a08a-4166-47d1-94b8-653ac02d7baf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17232024-11-27T18:35:23.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e830a08a-4166-47d1-94b8-653ac02d7baf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17242024-11-27T18:35:23.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e830a08a-4166-47d1-94b8-653ac02d7baf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17252024-11-27T18:35:24.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc08e39-a717-4f92-a592-d782b79b6b1c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17262024-11-27T18:35:24.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc08e39-a717-4f92-a592-d782b79b6b1c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17272024-11-27T18:35:24.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc08e39-a717-4f92-a592-d782b79b6b1c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17282024-11-27T18:35:25.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07122d2b-38cd-4e91-987b-4a9ed28a3493 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17292024-11-27T18:35:25.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07122d2b-38cd-4e91-987b-4a9ed28a3493 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17302024-11-27T18:35:25.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07122d2b-38cd-4e91-987b-4a9ed28a3493 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17312024-11-27T18:35:26.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66e8adb0-9bdb-40ae-9bcf-ff1cacf6f0a8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17322024-11-27T18:35:26.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66e8adb0-9bdb-40ae-9bcf-ff1cacf6f0a8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17332024-11-27T18:35:26.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 66e8adb0-9bdb-40ae-9bcf-ff1cacf6f0a8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17342024-11-27T18:35:27.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a70442b-958b-4f39-87d6-cf12a72ca998 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17352024-11-27T18:35:27.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a70442b-958b-4f39-87d6-cf12a72ca998 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17362024-11-27T18:35:27.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a70442b-958b-4f39-87d6-cf12a72ca998 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17372024-11-27T18:35:28.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4cb5f268-66a0-4374-9f91-0b651fab0967 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17382024-11-27T18:35:28.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4cb5f268-66a0-4374-9f91-0b651fab0967 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17392024-11-27T18:35:28.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4cb5f268-66a0-4374-9f91-0b651fab0967 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17402024-11-27T18:35:29.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46ad4409-a799-491c-919d-99d2f391c9ca roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17412024-11-27T18:35:29.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46ad4409-a799-491c-919d-99d2f391c9ca resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17422024-11-27T18:35:29.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46ad4409-a799-491c-919d-99d2f391c9ca response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17432024-11-27T18:35:30.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4c8dc03b-2563-4ecb-ae53-cbfdd833324c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17442024-11-27T18:35:30.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4c8dc03b-2563-4ecb-ae53-cbfdd833324c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17452024-11-27T18:35:30.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4c8dc03b-2563-4ecb-ae53-cbfdd833324c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
17462024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
17472024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
17482024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
17492024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17502024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
17512024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17522024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
17532024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17542024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
17552024-11-27T18:35:31.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17562024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17572024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17582024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
17592024-11-27T18:35:31.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17602024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17612024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17622024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
17632024-11-27T18:35:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
17642024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
17652024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.14\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
17662024-11-27T18:35:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17672024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
17682024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17692024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
17702024-11-27T18:35:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:25:31.390943021 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17712024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17722024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17732024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
17742024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17752024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
17762024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17772024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
17782024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
17792024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17802024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17812024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17822024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
17832024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
17842024-11-27T18:35:31.391ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
17852024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 11.68\u{b5}s iteration = 3 status = {"error":"no config"}
17862024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
17872024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
17882024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
17892024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17902024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17912024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17922024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
17932024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17942024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
17952024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17962024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17972024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
17982024-11-27T18:35:31.391ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
17992024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
18002024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18012024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 13.22\u{b5}s iteration = 3 status = {"error":"no config"}
18022024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18032024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
18042024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
18052024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18062024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18072024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
18082024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
18092024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18102024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
18112024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18122024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18132024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18142024-11-27T18:35:31.391ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 389962149 } })
18152024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18162024-11-27T18:35:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18172024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18182024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18192024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18202024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18212024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18222024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18232024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18242024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18252024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18262024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18272024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18282024-11-27T18:35:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 390201723 } })
18292024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18302024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18312024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18322024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18332024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18342024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18352024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18362024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18372024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18382024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18392024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.485522ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18402024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
18412024-11-27T18:35:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.229288ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
18422024-11-27T18:35:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-11-27T18:35:31.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18442024-11-27T18:35:31.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18452024-11-27T18:35:31.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18462024-11-27T18:35:31.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18472024-11-27T18:35:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18482024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18492024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18502024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18512024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18522024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18532024-11-27T18:35:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18542024-11-27T18:35:31.397ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552024-11-27T18:35:31.397ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 396041899 } })
18562024-11-27T18:35:31.398ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18572024-11-27T18:35:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18582024-11-27T18:35:31.399ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18592024-11-27T18:35:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18602024-11-27T18:35:31.400ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.036804ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
18612024-11-27T18:35:31.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18622024-11-27T18:35:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18632024-11-27T18:35:31.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18642024-11-27T18:35:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18652024-11-27T18:35:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.658773ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
18662024-11-27T18:35:31.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-11-27T18:35:31.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682024-11-27T18:35:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18692024-11-27T18:35:31.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18702024-11-27T18:35:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18712024-11-27T18:35:31.406ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:25:31.390943021 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18722024-11-27T18:35:31.406ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.929236ms iteration = 2 status = {"expiration":"2024-11-27T18:25:31.390943021Z","pruned":[]}
18732024-11-27T18:35:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18742024-11-27T18:35:31.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18752024-11-27T18:35:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762024-11-27T18:35:31.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 405918316 } })
18772024-11-27T18:35:31.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18782024-11-27T18:35:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18792024-11-27T18:35:31.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18802024-11-27T18:35:31.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-11-27T18:35:31.410ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.193055ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18822024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18832024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18842024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18852024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18862024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18872024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18882024-11-27T18:35:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18892024-11-27T18:35:31.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902024-11-27T18:35:31.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18912024-11-27T18:35:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18922024-11-27T18:35:31.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18932024-11-27T18:35:31.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 413094072 } })
18942024-11-27T18:35:31.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
18952024-11-27T18:35:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18962024-11-27T18:35:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18972024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18982024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18992024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19002024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19012024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19022024-11-27T18:35:31.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-11-27T18:35:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19042024-11-27T18:35:31.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
19052024-11-27T18:35:31.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19062024-11-27T18:35:31.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072024-11-27T18:35:31.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082024-11-27T18:35:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19092024-11-27T18:35:31.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19102024-11-27T18:35:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19112024-11-27T18:35:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19122024-11-27T18:35:31.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19132024-11-27T18:35:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19142024-11-27T18:35:31.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152024-11-27T18:35:31.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19162024-11-27T18:35:31.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.036751ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
19172024-11-27T18:35:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19182024-11-27T18:35:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19192024-11-27T18:35:31.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19202024-11-27T18:35:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19212024-11-27T18:35:31.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19222024-11-27T18:35:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19232024-11-27T18:35:31.449ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
19242024-11-27T18:35:31.449ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.909923ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
19252024-11-27T18:35:31.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19262024-11-27T18:35:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19272024-11-27T18:35:31.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19282024-11-27T18:35:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19292024-11-27T18:35:31.454ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19302024-11-27T18:35:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19312024-11-27T18:35:31.455ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19322024-11-27T18:35:31.455ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19332024-11-27T18:35:31.455ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.297773ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19342024-11-27T18:35:31.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.003844ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19352024-11-27T18:35:31.457ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19362024-11-27T18:35:31.457ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19372024-11-27T18:35:31.457ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19382024-11-27T18:35:31.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19392024-11-27T18:35:31.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19402024-11-27T18:35:31.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19412024-11-27T18:35:31.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19422024-11-27T18:35:31.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19432024-11-27T18:35:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19442024-11-27T18:35:31.461ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19452024-11-27T18:35:31.461ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19462024-11-27T18:35:31.461ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19472024-11-27T18:35:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19482024-11-27T18:35:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19492024-11-27T18:35:31.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19502024-11-27T18:35:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19512024-11-27T18:35:31.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 72.85303ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19522024-11-27T18:35:31.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19532024-11-27T18:35:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19542024-11-27T18:35:31.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552024-11-27T18:35:31.466ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19562024-11-27T18:35:31.466ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19572024-11-27T18:35:31.466ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.714623ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19582024-11-27T18:35:31.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19592024-11-27T18:35:31.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19602024-11-27T18:35:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19612024-11-27T18:35:31.467ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19622024-11-27T18:35:31.467ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19632024-11-27T18:35:31.467ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19642024-11-27T18:35:31.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19652024-11-27T18:35:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19662024-11-27T18:35:31.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-11-27T18:35:31.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19682024-11-27T18:35:31.469ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19692024-11-27T18:35:31.469ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19702024-11-27T18:35:31.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19712024-11-27T18:35:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19722024-11-27T18:35:31.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19732024-11-27T18:35:31.470ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19742024-11-27T18:35:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19752024-11-27T18:35:31.471ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19762024-11-27T18:35:31.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.109117ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19772024-11-27T18:35:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19782024-11-27T18:35:31.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19792024-11-27T18:35:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19802024-11-27T18:35:31.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812024-11-27T18:35:31.473ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19822024-11-27T18:35:31.473ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19832024-11-27T18:35:31.474ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b819358-46cf-4498-afb2-840399273263", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
19842024-11-27T18:35:31.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19852024-11-27T18:35:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19862024-11-27T18:35:31.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19872024-11-27T18:35:31.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19882024-11-27T18:35:31.476ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19892024-11-27T18:35:31.484ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 93.559326ms iteration = 5 status = {"physical_disks_added":0}
19902024-11-27T18:35:31.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.677718ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19912024-11-27T18:35:31.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.966852ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19922024-11-27T18:35:31.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19932024-11-27T18:35:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19942024-11-27T18:35:31.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19952024-11-27T18:35:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19962024-11-27T18:35:31.495ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19972024-11-27T18:35:31.495ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19982024-11-27T18:35:31.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.90623ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19992024-11-27T18:35:31.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002024-11-27T18:35:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
20012024-11-27T18:35:31.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20022024-11-27T18:35:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20032024-11-27T18:35:31.505ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20042024-11-27T18:35:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 114.548568ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20052024-11-27T18:35:31.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062024-11-27T18:35:31.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20072024-11-27T18:35:31.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20082024-11-27T18:35:31.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20092024-11-27T18:35:31.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20102024-11-27T18:35:31.511ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20112024-11-27T18:35:31.511ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
20122024-11-27T18:35:31.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20132024-11-27T18:35:31.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20142024-11-27T18:35:31.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20152024-11-27T18:35:31.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
20162024-11-27T18:35:31.522ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20172024-11-27T18:35:31.522ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eda40f3-005b-4a30-876c-8471877ede83", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20182024-11-27T18:35:31.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20192024-11-27T18:35:31.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
20202024-11-27T18:35:31.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50a07039-ca9d-4fac-9c98-da5c1629f686 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
20212024-11-27T18:35:31.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50a07039-ca9d-4fac-9c98-da5c1629f686 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
20222024-11-27T18:35:31.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20232024-11-27T18:35:31.553ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20242024-11-27T18:35:31.553ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e93f132-15c5-430e-9321-b798e70243c5", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20252024-11-27T18:35:31.553ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20262024-11-27T18:35:31.554ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20272024-11-27T18:35:31.588ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20282024-11-27T18:35:31.589ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7944112-62a6-478f-8d91-e8582b9d4276", "content-length": "691", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20292024-11-27T18:35:31.589ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20302024-11-27T18:35:31.589ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20312024-11-27T18:35:31.589ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20322024-11-27T18:35:31.590ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 199.659339ms iteration = 3 status = {}
20332024-11-27T18:35:31.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-11-27T18:35:31.591ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.3638ms iteration = 3 status = 0
20352024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20362024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20372024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20382024-11-27T18:35:31.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20392024-11-27T18:35:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20402024-11-27T18:35:31.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20412024-11-27T18:35:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20422024-11-27T18:35:31.611ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20432024-11-27T18:35:31.611ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20442024-11-27T18:35:31.611ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b7681de-a036-4f8d-aa46-7e29c0a84cb8", "content-length": "372", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20452024-11-27T18:35:31.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20462024-11-27T18:35:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20472024-11-27T18:35:31.613ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 222.635821ms iteration = 3 status = {}
20482024-11-27T18:35:31.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50a07039-ca9d-4fac-9c98-da5c1629f686 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
20492024-11-27T18:35:31.617ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
20502024-11-27T18:35:31.617ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20512024-11-27T18:35:31.617ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
20522024-11-27T18:35:31.617ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 226.114782ms iteration = 2 status = {"generation":2}
20532024-11-27T18:35:31.617ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
20542024-11-27T18:35:31.620ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20552024-11-27T18:35:31.620ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20562024-11-27T18:35:31.620ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
20572024-11-27T18:35:31.620ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 229.056925ms iteration = 2 status = {"generation":1}
20582024-11-27T18:35:31.620ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
20592024-11-27T18:35:31.663ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20602024-11-27T18:35:31.663ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5b5c769-fe28-4f96-bf3f-de33a4389948", "content-length": "1", "date": "Wed, 27 Nov 2024 18:35:30 GMT"} })
20612024-11-27T18:35:31.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20622024-11-27T18:35:31.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20632024-11-27T18:35:31.682ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20642024-11-27T18:35:31.682ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20652024-11-27T18:35:31.683ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0c0912f-cd3b-4748-baba-30540d369fbf", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20662024-11-27T18:35:31.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20672024-11-27T18:35:31.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20682024-11-27T18:35:31.687ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
20692024-11-27T18:35:31.687ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 296.408954ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20702024-11-27T18:35:31.688ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.118484ms iteration = 3 status = null
20712024-11-27T18:35:31.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20722024-11-27T18:35:31.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20732024-11-27T18:35:31.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20742024-11-27T18:35:31.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20752024-11-27T18:35:31.696ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20762024-11-27T18:35:31.696ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20772024-11-27T18:35:31.697ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2c41e21-1c1b-4084-a0ad-c0d76cc5c51f", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
20782024-11-27T18:35:31.699ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.164718ms iteration = 3 status = {}
20792024-11-27T18:35:31.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
20802024-11-27T18:35:31.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20812024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
20822024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
20832024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
20842024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
20852024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
20862024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
20872024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
20882024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
20892024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
20902024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
20912024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
20922024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
20932024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
20942024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
20952024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
20962024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
20972024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
20982024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
20992024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
21002024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
21012024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
21022024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
21032024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
21042024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
21052024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
21062024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
21072024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
21082024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
21092024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
21102024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
21112024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
21122024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
21132024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21142024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21152024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21162024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
21172024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21182024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
21192024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
21202024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21212024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21222024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21232024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21242024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21252024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
21262024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
21272024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
21282024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
21292024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
21302024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
21312024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
21322024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
21332024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
21342024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
21352024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
21362024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
21372024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
21382024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
21392024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21402024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21412024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
21422024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21432024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21442024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
21452024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
21462024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21472024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21482024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
21492024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
21502024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21512024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21522024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21532024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
21542024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
21552024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21562024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
21572024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
21582024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21592024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
21602024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
21612024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
21622024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
21632024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
21642024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
21652024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
21662024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
21672024-11-27T18:35:31.728ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
21682024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21692024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21702024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
21712024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
21722024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
21732024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21742024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
21752024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
21762024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
21772024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
21782024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
21792024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
21802024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
21812024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
21822024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
21832024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
21842024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
21852024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
21862024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
21872024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
21882024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
21892024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
21902024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
21912024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
21922024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
21932024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
21942024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
21952024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
21962024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
21972024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
21982024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
21992024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22002024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22012024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
22022024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22032024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22042024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22052024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
22062024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22072024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
22082024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
22092024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22102024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22112024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
22122024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22132024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
22142024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
22152024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22162024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
22172024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22182024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22192024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22202024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22212024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22222024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22232024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22242024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22252024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22262024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
22272024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22282024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22292024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22302024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
22312024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
22322024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
22332024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22342024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22352024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
22362024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
22372024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
22382024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
22392024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
22402024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
22412024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
22422024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
22432024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22442024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22452024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22462024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22472024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
22482024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
22492024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22502024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
22512024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
22522024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
22532024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22542024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22552024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
22562024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
22572024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22582024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
22592024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
22602024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
22612024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
22622024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
22632024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
22642024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
22652024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
22662024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
22672024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22682024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
22692024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22702024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22712024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22722024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
22732024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
22742024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
22752024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
22762024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
22772024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
22782024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
22792024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
22802024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
22812024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
22822024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
22832024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
22842024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
22852024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
22862024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
22872024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
22882024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
22892024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
22902024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
22912024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
22922024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
22932024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
22942024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
22952024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
22962024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
22972024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
22982024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
22992024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23002024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23012024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23022024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
23032024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
23042024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
23052024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
23062024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
23072024-11-27T18:35:31.729ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.6:443
23082024-11-27T18:35:31.729ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
23092024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
23102024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
23112024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
23122024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
23132024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
23142024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
23152024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
23162024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
23172024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
23182024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
23192024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23202024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
23212024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
23222024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
23232024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
23242024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23252024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23262024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23272024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
23282024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
23292024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
23302024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
23312024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
23322024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
23332024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
23342024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
23352024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
23362024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
23372024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
23382024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
23392024-11-27T18:35:31.737ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
23402024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
23412024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
23422024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
23432024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
23442024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
23452024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
23462024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
23472024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
23482024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
23492024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
23502024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
23512024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
23522024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
23532024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
23542024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
23552024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
23562024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
23572024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
23582024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
23592024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
23602024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
23612024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
23622024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
23632024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
23642024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
23652024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
23662024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
23672024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
23682024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
23692024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
23702024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23712024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23722024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
23732024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
23742024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23752024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23762024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
23772024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
23782024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
23792024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
23802024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
23812024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
23822024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
23832024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
23842024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
23852024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
23862024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
23872024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
23882024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
23892024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
23902024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
23912024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
23922024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
23932024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
23942024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
23952024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
23962024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
23972024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
23982024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
23992024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
24002024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
24012024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24022024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
24032024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
24042024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
24052024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
24062024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
24072024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
24082024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
24092024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
24102024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
24112024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
24122024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
24132024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
24142024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
24152024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
24162024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
24172024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
24182024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
24192024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
24202024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
24212024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
24222024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
24232024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
24242024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
24252024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
24262024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
24272024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
24282024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
24292024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
24302024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
24312024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
24322024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
24332024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
24342024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
24352024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
24362024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
24372024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
24382024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
24392024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
24402024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
24412024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
24422024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
24432024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
24442024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
24452024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
24462024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
24472024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
24482024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
24492024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
24502024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
24512024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24522024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24532024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
24542024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
24552024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
24562024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
24572024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
24582024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
24592024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
24602024-11-27T18:35:31.738ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
24612024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
24622024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
24632024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
24642024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
24652024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
24662024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
24672024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
24682024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
24692024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
24702024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
24712024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24722024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24732024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24742024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24752024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
24762024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
24772024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24782024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
24792024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
24802024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
24812024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
24822024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
24832024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
24842024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
24852024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
24862024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
24872024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
24882024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
24892024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
24902024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
24912024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
24922024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
24932024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
24942024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
24952024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
24962024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
24972024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
24982024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
24992024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25002024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
25012024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
25022024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
25032024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
25042024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
25052024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
25062024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
25072024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
25082024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
25092024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
25102024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
25112024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
25122024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
25132024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
25142024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
25152024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
25162024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
25172024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
25182024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
25192024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
25202024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
25212024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
25222024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
25232024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
25242024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
25252024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
25262024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
25272024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
25282024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
25292024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
25302024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
25312024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
25322024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
25332024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
25342024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
25352024-11-27T18:35:31.739ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12228
25362024-11-27T18:35:31.739ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
25372024-11-27T18:35:31.742ZDEBGnexus (nexus-producer-server): registered DTrace probes
25382024-11-27T18:35:31.746ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:56027 method = GET path = /{producer_id} versions = all
25392024-11-27T18:35:31.747ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:56027
25402024-11-27T18:35:31.747ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:56027
25412024-11-27T18:35:31.747ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:56027
25422024-11-27T18:35:31.747ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
25432024-11-27T18:35:31.747ZDEBGnexus (nexus-producer-server): starting producer registration task
25442024-11-27T18:35:31.748ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:56027 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 236c7b74-8315-46e3-9a37-90380a675558
25452024-11-27T18:35:31.748ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25462024-11-27T18:35:31.748ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
25472024-11-27T18:35:31.833ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25482024-11-27T18:35:31.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25492024-11-27T18:35:31.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2f1aeda5-35f4-4854-a967-e13fb7b74727", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25502024-11-27T18:35:31.838ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25512024-11-27T18:35:31.840ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6ce14ef8-4fbb-497d-a3b4-319fb54e8a24", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25522024-11-27T18:35:31.840ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25532024-11-27T18:35:31.841ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25542024-11-27T18:35:31.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 224.760901ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25552024-11-27T18:35:31.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25562024-11-27T18:35:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25572024-11-27T18:35:31.856ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
25582024-11-27T18:35:31.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25592024-11-27T18:35:31.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25602024-11-27T18:35:31.858ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
25612024-11-27T18:35:31.859ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36544
25622024-11-27T18:35:31.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36544 req_id = f576b1c0-a90c-4449-82b4-181ed503fa67 roles = RoleSet { roles: {} } uri = /metrics/producers
25632024-11-27T18:35:31.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36544 req_id = f576b1c0-a90c-4449-82b4-181ed503fa67 resource = Database result = Ok(()) uri = /metrics/producers
25642024-11-27T18:35:31.880ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25652024-11-27T18:35:31.880ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "56681896-d661-4a01-9101-6dfe008b3d17", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25662024-11-27T18:35:31.880ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25672024-11-27T18:35:31.882ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6792f782-bf02-4222-83c5-135397a82805", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25682024-11-27T18:35:31.882ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25692024-11-27T18:35:31.884ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0dfac1d8-3476-4996-9842-ec2bcc729530", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25702024-11-27T18:35:31.884ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25712024-11-27T18:35:31.886ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25722024-11-27T18:35:31.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 265.911491ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25732024-11-27T18:35:31.907ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 236c7b74-8315-46e3-9a37-90380a675558
25742024-11-27T18:35:31.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50678 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36544 req_id = f576b1c0-a90c-4449-82b4-181ed503fa67 response_code = 201 uri = /metrics/producers
25752024-11-27T18:35:31.909ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f576b1c0-a90c-4449-82b4-181ed503fa67", "content-length": "41", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
25762024-11-27T18:35:31.911ZDEBGnexus (producer-registration-task): registered with nexus successfully
25772024-11-27T18:35:31.911ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
25782024-11-27T18:35:31.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25792024-11-27T18:35:31.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "693081bb-ca78-4098-b06f-d72332407891", "content-length": "134", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
25802024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25812024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
25822024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25832024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25842024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25852024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25862024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25872024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25882024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25892024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25902024-11-27T18:35:31.964ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
25912024-11-27T18:35:31.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25922024-11-27T18:35:31.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25932024-11-27T18:35:31.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25942024-11-27T18:35:31.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "024f4e21-ca5e-47a7-aa5f-025af44b84ef", "content-length": "2", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
25952024-11-27T18:35:31.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25962024-11-27T18:35:31.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2d1b6f2-aae3-47d3-8ef3-61924560a60b", "content-length": "52", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
25972024-11-27T18:35:31.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
25982024-11-27T18:35:31.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25992024-11-27T18:35:32.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1c77ebf3-c1c2-44e6-8989-f27f862d63b0", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
26002024-11-27T18:35:32.100ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
26012024-11-27T18:35:32.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26022024-11-27T18:35:32.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "177a0ba3-d6f1-4e11-82ce-dc072260106f", "content-length": "682", "date": "Wed, 27 Nov 2024 18:35:32 GMT"} })
26032024-11-27T18:35:32.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26042024-11-27T18:35:32.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26052024-11-27T18:35:32.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f205fa90-1281-433d-9aa9-c589a4ac47de roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
26062024-11-27T18:35:32.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f205fa90-1281-433d-9aa9-c589a4ac47de resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
26072024-11-27T18:35:32.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f205fa90-1281-433d-9aa9-c589a4ac47de response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
26082024-11-27T18:35:32.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26092024-11-27T18:35:32.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26102024-11-27T18:35:32.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26112024-11-27T18:35:32.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26122024-11-27T18:35:32.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26132024-11-27T18:35:32.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26142024-11-27T18:35:32.225ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 834.146173ms iteration = 3 status = {}
26152024-11-27T18:35:32.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eabdd8c0-2486-46e9-9c69-70a43ffbefe5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26162024-11-27T18:35:32.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eabdd8c0-2486-46e9-9c69-70a43ffbefe5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26172024-11-27T18:35:32.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eabdd8c0-2486-46e9-9c69-70a43ffbefe5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26182024-11-27T18:35:33.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e8d17a-b0bb-431f-bf15-1c6cc795658f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26192024-11-27T18:35:33.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e8d17a-b0bb-431f-bf15-1c6cc795658f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26202024-11-27T18:35:33.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e8d17a-b0bb-431f-bf15-1c6cc795658f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26212024-11-27T18:35:34.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ad7de11-de18-460f-9de6-39066376e0d0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26222024-11-27T18:35:34.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ad7de11-de18-460f-9de6-39066376e0d0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26232024-11-27T18:35:34.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ad7de11-de18-460f-9de6-39066376e0d0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26242024-11-27T18:35:35.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0abb716a-a1fe-4c6c-a293-33a9b3f5129b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26252024-11-27T18:35:35.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0abb716a-a1fe-4c6c-a293-33a9b3f5129b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26262024-11-27T18:35:35.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0abb716a-a1fe-4c6c-a293-33a9b3f5129b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26272024-11-27T18:35:36.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = def1b1b1-3723-48f0-9a06-54b1de98c244 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26282024-11-27T18:35:36.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = def1b1b1-3723-48f0-9a06-54b1de98c244 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26292024-11-27T18:35:36.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = def1b1b1-3723-48f0-9a06-54b1de98c244 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26302024-11-27T18:35:37.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e694b954-1b8d-4100-a5c8-857ced86fd66 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26312024-11-27T18:35:37.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e694b954-1b8d-4100-a5c8-857ced86fd66 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26322024-11-27T18:35:37.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e694b954-1b8d-4100-a5c8-857ced86fd66 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26332024-11-27T18:35:38.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e3ad46-aabb-4082-b356-ac3eda124d1d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26342024-11-27T18:35:38.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e3ad46-aabb-4082-b356-ac3eda124d1d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26352024-11-27T18:35:38.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e3ad46-aabb-4082-b356-ac3eda124d1d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26362024-11-27T18:35:39.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78b1a712-d56b-4513-a54e-3f64f4ccdd01 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26372024-11-27T18:35:39.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78b1a712-d56b-4513-a54e-3f64f4ccdd01 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26382024-11-27T18:35:39.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78b1a712-d56b-4513-a54e-3f64f4ccdd01 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26392024-11-27T18:35:40.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed077399-43fe-4e63-82fd-bdf509217e5f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26402024-11-27T18:35:40.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed077399-43fe-4e63-82fd-bdf509217e5f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26412024-11-27T18:35:40.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed077399-43fe-4e63-82fd-bdf509217e5f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26422024-11-27T18:35:41.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
26432024-11-27T18:35:41.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442024-11-27T18:35:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452024-11-27T18:35:41.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
26462024-11-27T18:35:41.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26472024-11-27T18:35:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26482024-11-27T18:35:41.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26492024-11-27T18:35:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26502024-11-27T18:35:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26512024-11-27T18:35:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26522024-11-27T18:35:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26532024-11-27T18:35:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26542024-11-27T18:35:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.224513ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26552024-11-27T18:35:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26562024-11-27T18:35:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26572024-11-27T18:35:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26582024-11-27T18:35:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
26592024-11-27T18:35:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26602024-11-27T18:35:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26612024-11-27T18:35:41.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
26622024-11-27T18:35:41.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.966096ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
26632024-11-27T18:35:41.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c406db30-745c-4f59-9c19-572a3eca4403 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26642024-11-27T18:35:41.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c406db30-745c-4f59-9c19-572a3eca4403 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26652024-11-27T18:35:41.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c406db30-745c-4f59-9c19-572a3eca4403 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26662024-11-27T18:35:42.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78016487-f4a4-4f27-9809-9eaedbc3c795 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26672024-11-27T18:35:42.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78016487-f4a4-4f27-9809-9eaedbc3c795 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26682024-11-27T18:35:42.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 78016487-f4a4-4f27-9809-9eaedbc3c795 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26692024-11-27T18:35:43.709ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:56027 remote_addr = [fd00:1122:3344:101::d]:38545
26702024-11-27T18:35:43.718ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9239 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 2887bfa3-14b9-4992-8e37-fa4d09f8f974 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
26712024-11-27T18:35:43.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a129f45-40fb-43a9-a5ed-6354f7a7d87a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26722024-11-27T18:35:43.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a129f45-40fb-43a9-a5ed-6354f7a7d87a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26732024-11-27T18:35:43.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a129f45-40fb-43a9-a5ed-6354f7a7d87a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26742024-11-27T18:35:44.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4efb437f-c906-47cd-8377-23146cf252f5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26752024-11-27T18:35:44.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4efb437f-c906-47cd-8377-23146cf252f5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26762024-11-27T18:35:44.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4efb437f-c906-47cd-8377-23146cf252f5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26772024-11-27T18:35:45.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efe2c666-0423-492f-b464-42aff1c7b635 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26782024-11-27T18:35:45.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efe2c666-0423-492f-b464-42aff1c7b635 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26792024-11-27T18:35:45.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = efe2c666-0423-492f-b464-42aff1c7b635 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26802024-11-27T18:35:46.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c1762446-182e-469a-9ad1-694f80776bc0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26812024-11-27T18:35:46.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c1762446-182e-469a-9ad1-694f80776bc0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26822024-11-27T18:35:46.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c1762446-182e-469a-9ad1-694f80776bc0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26832024-11-27T18:35:47.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = de2efcda-ad47-4f7d-af47-49b584fb2ac5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26842024-11-27T18:35:47.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = de2efcda-ad47-4f7d-af47-49b584fb2ac5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26852024-11-27T18:35:47.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = de2efcda-ad47-4f7d-af47-49b584fb2ac5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26862024-11-27T18:35:48.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6b1abea-285e-4550-828e-7fcb6b23e24c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26872024-11-27T18:35:48.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6b1abea-285e-4550-828e-7fcb6b23e24c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26882024-11-27T18:35:48.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6b1abea-285e-4550-828e-7fcb6b23e24c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26892024-11-27T18:35:50.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b84878b9-62bb-47fd-b876-1dbe1008049c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26902024-11-27T18:35:50.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b84878b9-62bb-47fd-b876-1dbe1008049c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26912024-11-27T18:35:50.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b84878b9-62bb-47fd-b876-1dbe1008049c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26922024-11-27T18:35:51.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fa0fd3b9-9f89-4334-9dd1-cc68de33baf2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26932024-11-27T18:35:51.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fa0fd3b9-9f89-4334-9dd1-cc68de33baf2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26942024-11-27T18:35:51.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fa0fd3b9-9f89-4334-9dd1-cc68de33baf2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
26952024-11-27T18:35:51.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
26962024-11-27T18:35:51.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26972024-11-27T18:35:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26982024-11-27T18:35:51.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
26992024-11-27T18:35:51.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27002024-11-27T18:35:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27012024-11-27T18:35:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27022024-11-27T18:35:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27032024-11-27T18:35:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27042024-11-27T18:35:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27052024-11-27T18:35:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27062024-11-27T18:35:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27072024-11-27T18:35:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27082024-11-27T18:35:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27092024-11-27T18:35:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27102024-11-27T18:35:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
27112024-11-27T18:35:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27122024-11-27T18:35:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27132024-11-27T18:35:51.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
27142024-11-27T18:35:51.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.643581ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
27152024-11-27T18:35:51.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.520847ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27162024-11-27T18:35:52.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a617be7b-ef85-4aaf-a2a3-856d86dd7fd8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27172024-11-27T18:35:52.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a617be7b-ef85-4aaf-a2a3-856d86dd7fd8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27182024-11-27T18:35:52.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a617be7b-ef85-4aaf-a2a3-856d86dd7fd8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27192024-11-27T18:35:53.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a614336-5067-4187-a989-d2f9c1cfa6c9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27202024-11-27T18:35:53.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a614336-5067-4187-a989-d2f9c1cfa6c9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27212024-11-27T18:35:53.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9a614336-5067-4187-a989-d2f9c1cfa6c9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27222024-11-27T18:35:53.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = dd8fe5ab-f717-4754-b1cd-4aa82c1e61c9 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
27232024-11-27T18:35:54.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef8d39-7934-48e0-94cf-628516828993 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27242024-11-27T18:35:54.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef8d39-7934-48e0-94cf-628516828993 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27252024-11-27T18:35:54.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 40ef8d39-7934-48e0-94cf-628516828993 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27262024-11-27T18:35:55.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7fbb7f5-e93a-4ada-9da7-4593c65e971c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27272024-11-27T18:35:55.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7fbb7f5-e93a-4ada-9da7-4593c65e971c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27282024-11-27T18:35:55.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c7fbb7f5-e93a-4ada-9da7-4593c65e971c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27292024-11-27T18:35:56.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c284389-deef-4b6a-bd6f-0d61f587d804 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27302024-11-27T18:35:56.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c284389-deef-4b6a-bd6f-0d61f587d804 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27312024-11-27T18:35:56.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c284389-deef-4b6a-bd6f-0d61f587d804 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27322024-11-27T18:35:57.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 33cfb485-30f1-4f45-8260-76a35f775436 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27332024-11-27T18:35:57.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 33cfb485-30f1-4f45-8260-76a35f775436 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27342024-11-27T18:35:57.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 33cfb485-30f1-4f45-8260-76a35f775436 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27352024-11-27T18:35:58.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8210fbc0-ad26-48f6-ae03-88296b60e0ba roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27362024-11-27T18:35:58.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8210fbc0-ad26-48f6-ae03-88296b60e0ba resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27372024-11-27T18:35:58.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8210fbc0-ad26-48f6-ae03-88296b60e0ba response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27382024-11-27T18:35:59.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 276ad55e-0095-44bb-99a2-88a803106dd6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27392024-11-27T18:35:59.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 276ad55e-0095-44bb-99a2-88a803106dd6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27402024-11-27T18:35:59.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 276ad55e-0095-44bb-99a2-88a803106dd6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27412024-11-27T18:36:00.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1f019d5-158e-471c-b041-f0f17d033d40 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27422024-11-27T18:36:00.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1f019d5-158e-471c-b041-f0f17d033d40 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27432024-11-27T18:36:00.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1f019d5-158e-471c-b041-f0f17d033d40 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27442024-11-27T18:36:01.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad75ae8e-e0b7-4312-a720-218db4a9b18b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27452024-11-27T18:36:01.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad75ae8e-e0b7-4312-a720-218db4a9b18b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27462024-11-27T18:36:01.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad75ae8e-e0b7-4312-a720-218db4a9b18b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
27472024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
27482024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
27492024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27502024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27512024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27522024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27532024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
27542024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27552024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27562024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27572024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27582024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27592024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27602024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
27612024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27622024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
27632024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
27642024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27652024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27662024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27672024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27682024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
27692024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
27702024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27712024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
27722024-11-27T18:36:01.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27732024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
27742024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27752024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27762024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27772024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27782024-11-27T18:36:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27792024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27802024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27812024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27822024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27832024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27842024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27852024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27862024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27872024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27882024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27892024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
27902024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
27912024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27922024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
27932024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27942024-11-27T18:36:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27952024-11-27T18:36:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27962024-11-27T18:36:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27972024-11-27T18:36:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27982024-11-27T18:36:01.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992024-11-27T18:36:01.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.251453ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
28002024-11-27T18:36:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.790911ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
28012024-11-27T18:36:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.877792ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28022024-11-27T18:36:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28032024-11-27T18:36:01.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28042024-11-27T18:36:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28052024-11-27T18:36:01.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 396846761 } })
28062024-11-27T18:36:01.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-11-27T18:36:01.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28082024-11-27T18:36:01.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28092024-11-27T18:36:01.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28102024-11-27T18:36:01.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28112024-11-27T18:36:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28122024-11-27T18:36:01.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 399157295 } })
28132024-11-27T18:36:01.401ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28142024-11-27T18:36:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28152024-11-27T18:36:01.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28162024-11-27T18:36:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28172024-11-27T18:36:01.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28182024-11-27T18:36:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28192024-11-27T18:36:01.403ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28202024-11-27T18:36:01.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212024-11-27T18:36:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28222024-11-27T18:36:01.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28232024-11-27T18:36:01.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28242024-11-27T18:36:01.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28252024-11-27T18:36:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28262024-11-27T18:36:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28272024-11-27T18:36:01.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.940866ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28282024-11-27T18:36:01.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28292024-11-27T18:36:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28302024-11-27T18:36:01.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28312024-11-27T18:36:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28322024-11-27T18:36:01.430ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28332024-11-27T18:36:01.430ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28342024-11-27T18:36:01.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28352024-11-27T18:36:01.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28362024-11-27T18:36:01.434ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28372024-11-27T18:36:01.434ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28382024-11-27T18:36:01.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28392024-11-27T18:36:01.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28402024-11-27T18:36:01.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28412024-11-27T18:36:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28422024-11-27T18:36:01.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28432024-11-27T18:36:01.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28442024-11-27T18:36:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28452024-11-27T18:36:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28462024-11-27T18:36:01.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28472024-11-27T18:36:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28482024-11-27T18:36:01.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28492024-11-27T18:36:01.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28502024-11-27T18:36:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28512024-11-27T18:36:01.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.610445ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28522024-11-27T18:36:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28532024-11-27T18:36:01.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28542024-11-27T18:36:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28552024-11-27T18:36:01.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562024-11-27T18:36:01.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28572024-11-27T18:36:01.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28582024-11-27T18:36:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28592024-11-27T18:36:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28602024-11-27T18:36:01.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28612024-11-27T18:36:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28622024-11-27T18:36:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
28632024-11-27T18:36:01.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28642024-11-27T18:36:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28652024-11-27T18:36:01.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28662024-11-27T18:36:01.454ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28672024-11-27T18:36:01.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28682024-11-27T18:36:01.454ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28692024-11-27T18:36:01.454ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c8d891-60bd-4b97-9428-853434747764", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
28702024-11-27T18:36:01.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28712024-11-27T18:36:01.454ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f257e758-ec55-4158-9902-38115b695a82", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
28722024-11-27T18:36:01.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28732024-11-27T18:36:01.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28742024-11-27T18:36:01.456ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28752024-11-27T18:36:01.459ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28762024-11-27T18:36:01.459ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.331868ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28772024-11-27T18:36:01.473ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
28782024-11-27T18:36:01.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.288645ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
28792024-11-27T18:36:01.475ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28802024-11-27T18:36:01.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28812024-11-27T18:36:01.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28822024-11-27T18:36:01.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28832024-11-27T18:36:01.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28842024-11-27T18:36:01.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28852024-11-27T18:36:01.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28862024-11-27T18:36:01.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
28872024-11-27T18:36:01.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28882024-11-27T18:36:01.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28892024-11-27T18:36:01.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.863486ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28902024-11-27T18:36:01.488ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.647687ms iteration = 4 status = 0
28912024-11-27T18:36:01.496ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28922024-11-27T18:36:01.496ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28932024-11-27T18:36:01.496ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.815188ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28942024-11-27T18:36:01.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28952024-11-27T18:36:01.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28962024-11-27T18:36:01.511ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28972024-11-27T18:36:01.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.630383ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
28982024-11-27T18:36:01.512ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e99fca-b1ee-45e7-9512-a4681490fe92", "content-length": "1", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
28992024-11-27T18:36:01.513ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29002024-11-27T18:36:01.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29012024-11-27T18:36:01.515ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 125.006173ms iteration = 4 status = {}
29022024-11-27T18:36:01.516ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 124.389114ms iteration = 4 status = null
29032024-11-27T18:36:01.528ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.156098ms iteration = 6 status = {"physical_disks_added":0}
29042024-11-27T18:36:01.533ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29052024-11-27T18:36:01.533ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29062024-11-27T18:36:01.533ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d089904f-5c75-4035-a9ec-d1f3faec753a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29072024-11-27T18:36:01.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29082024-11-27T18:36:01.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29092024-11-27T18:36:01.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 549585425 } })
29102024-11-27T18:36:01.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
29112024-11-27T18:36:01.562ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29122024-11-27T18:36:01.562ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29132024-11-27T18:36:01.563ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0b249e0b-ed8f-40fd-bd3c-263062417980", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29142024-11-27T18:36:01.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29152024-11-27T18:36:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29162024-11-27T18:36:01.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29172024-11-27T18:36:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29182024-11-27T18:36:01.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29192024-11-27T18:36:01.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29202024-11-27T18:36:01.573ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29212024-11-27T18:36:01.573ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29222024-11-27T18:36:01.573ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74cb22d3-8997-44c2-8d3b-60e73e2a0292", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29232024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 184.314663ms iteration = 4 status = {}
29242024-11-27T18:36:01.582ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
29252024-11-27T18:36:01.582ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29262024-11-27T18:36:01.583ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29c89553-1631-46e2-9bda-2f7b5cec81a6", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29272024-11-27T18:36:01.583ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29282024-11-27T18:36:01.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
29292024-11-27T18:36:01.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29302024-11-27T18:36:01.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29312024-11-27T18:36:01.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29322024-11-27T18:36:01.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29332024-11-27T18:36:01.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29342024-11-27T18:36:01.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29352024-11-27T18:36:01.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29372024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29382024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29392024-11-27T18:36:01.705ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29402024-11-27T18:36:01.705ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "12628648-29ab-403b-b128-887aa842a844", "content-length": "691", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29412024-11-27T18:36:01.705ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29422024-11-27T18:36:01.705ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29432024-11-27T18:36:01.705ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29442024-11-27T18:36:01.706ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.388809ms iteration = 4 status = {}
29452024-11-27T18:36:01.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29462024-11-27T18:36:01.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29472024-11-27T18:36:01.723ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
29482024-11-27T18:36:01.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29492024-11-27T18:36:01.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29502024-11-27T18:36:01.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29512024-11-27T18:36:01.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "73031d6d-b177-481a-9b0f-f6ec4646dcaa", "content-length": "134", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29522024-11-27T18:36:01.937ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29532024-11-27T18:36:01.937ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
29542024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29552024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29562024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29572024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29582024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29592024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29602024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29612024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29622024-11-27T18:36:01.938ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
29632024-11-27T18:36:01.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29642024-11-27T18:36:01.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29652024-11-27T18:36:01.941ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29662024-11-27T18:36:01.941ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb75bb1b-9c2a-4b17-ab0c-bdb45899e16a", "content-length": "2", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29672024-11-27T18:36:01.941ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29682024-11-27T18:36:01.941ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "35cdba61-3301-41d8-8f16-6f2cdd4a50c5", "content-length": "52", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29692024-11-27T18:36:01.941ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
29702024-11-27T18:36:01.941ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29712024-11-27T18:36:02.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1bfc95d5-a041-4fc7-b126-ac9d9c63fa1b", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
29722024-11-27T18:36:02.059ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
29732024-11-27T18:36:02.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29742024-11-27T18:36:02.064ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1d73563-9e40-4284-8ec1-7e0b807e9667", "content-length": "682", "date": "Wed, 27 Nov 2024 18:36:02 GMT"} })
29752024-11-27T18:36:02.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29762024-11-27T18:36:02.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29772024-11-27T18:36:02.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29782024-11-27T18:36:02.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29792024-11-27T18:36:02.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29802024-11-27T18:36:02.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29812024-11-27T18:36:02.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29822024-11-27T18:36:02.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29832024-11-27T18:36:02.082ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.55226ms iteration = 4 status = {}
29842024-11-27T18:36:02.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 14f819fd-9ce4-4216-904d-f7dbc9b2197d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
29852024-11-27T18:36:02.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 14f819fd-9ce4-4216-904d-f7dbc9b2197d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
29862024-11-27T18:36:02.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 14f819fd-9ce4-4216-904d-f7dbc9b2197d response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
29872024-11-27T18:36:02.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49fccda8-0d70-4d11-82fd-f60867043b84 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29882024-11-27T18:36:02.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49fccda8-0d70-4d11-82fd-f60867043b84 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29892024-11-27T18:36:02.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49fccda8-0d70-4d11-82fd-f60867043b84 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29902024-11-27T18:36:03.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 645a4897-3c40-4ff4-a5a9-3475bd9dd092 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29912024-11-27T18:36:03.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 645a4897-3c40-4ff4-a5a9-3475bd9dd092 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29922024-11-27T18:36:03.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 645a4897-3c40-4ff4-a5a9-3475bd9dd092 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29932024-11-27T18:36:03.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 643 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 281b84a4-d1d0-4c79-bc85-9efce571f942 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
29942024-11-27T18:36:04.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 988d6fd8-1d7f-4eba-961a-7d65e1c0ced9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29952024-11-27T18:36:04.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 988d6fd8-1d7f-4eba-961a-7d65e1c0ced9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29962024-11-27T18:36:04.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 988d6fd8-1d7f-4eba-961a-7d65e1c0ced9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29972024-11-27T18:36:05.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a4c4915-aaed-4017-95ec-5e815b8f38ec roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29982024-11-27T18:36:05.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a4c4915-aaed-4017-95ec-5e815b8f38ec resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
29992024-11-27T18:36:05.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a4c4915-aaed-4017-95ec-5e815b8f38ec response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30002024-11-27T18:36:06.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b10aa43-c42d-4e6a-8a03-1f8d361e7bc7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30012024-11-27T18:36:06.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b10aa43-c42d-4e6a-8a03-1f8d361e7bc7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30022024-11-27T18:36:06.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b10aa43-c42d-4e6a-8a03-1f8d361e7bc7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30032024-11-27T18:36:07.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db5c5995-4afb-424b-8c8c-c929d2be2c8b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30042024-11-27T18:36:07.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db5c5995-4afb-424b-8c8c-c929d2be2c8b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30052024-11-27T18:36:07.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db5c5995-4afb-424b-8c8c-c929d2be2c8b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30062024-11-27T18:36:08.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a95728a-4911-43d7-b61f-86503d064118 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30072024-11-27T18:36:08.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a95728a-4911-43d7-b61f-86503d064118 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30082024-11-27T18:36:08.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a95728a-4911-43d7-b61f-86503d064118 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30092024-11-27T18:36:09.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2f2af72-9abd-4d96-b432-b3bdec3c6320 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30102024-11-27T18:36:09.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2f2af72-9abd-4d96-b432-b3bdec3c6320 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30112024-11-27T18:36:09.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e2f2af72-9abd-4d96-b432-b3bdec3c6320 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30122024-11-27T18:36:10.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5427a605-7926-4b0c-ba48-d46f30122ee9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30132024-11-27T18:36:10.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5427a605-7926-4b0c-ba48-d46f30122ee9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30142024-11-27T18:36:10.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5427a605-7926-4b0c-ba48-d46f30122ee9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30152024-11-27T18:36:11.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
30162024-11-27T18:36:11.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30172024-11-27T18:36:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30182024-11-27T18:36:11.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30192024-11-27T18:36:11.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30202024-11-27T18:36:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30212024-11-27T18:36:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222024-11-27T18:36:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30232024-11-27T18:36:11.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30242024-11-27T18:36:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30252024-11-27T18:36:11.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30262024-11-27T18:36:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30272024-11-27T18:36:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30282024-11-27T18:36:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
30292024-11-27T18:36:11.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30302024-11-27T18:36:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30312024-11-27T18:36:11.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
30322024-11-27T18:36:11.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.975656ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
30332024-11-27T18:36:11.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30342024-11-27T18:36:11.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30352024-11-27T18:36:11.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.341465ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30362024-11-27T18:36:11.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 716f47ca-e4cc-46e0-8b1c-8b07866cecd3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30372024-11-27T18:36:11.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 716f47ca-e4cc-46e0-8b1c-8b07866cecd3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30382024-11-27T18:36:11.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 716f47ca-e4cc-46e0-8b1c-8b07866cecd3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30392024-11-27T18:36:12.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6a01fa6-087a-4885-a583-3ba4384de57d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30402024-11-27T18:36:12.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6a01fa6-087a-4885-a583-3ba4384de57d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30412024-11-27T18:36:12.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6a01fa6-087a-4885-a583-3ba4384de57d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30422024-11-27T18:36:13.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ff0d6de-f6fa-4d85-b249-c92d94c70b5f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30432024-11-27T18:36:13.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ff0d6de-f6fa-4d85-b249-c92d94c70b5f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30442024-11-27T18:36:13.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3ff0d6de-f6fa-4d85-b249-c92d94c70b5f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30452024-11-27T18:36:13.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 32f40257-a6d5-4ee1-8daa-1eb1a1cce6ee response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
30462024-11-27T18:36:14.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c26c5fe0-fb4d-473c-832e-69e2d4574b31 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30472024-11-27T18:36:14.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c26c5fe0-fb4d-473c-832e-69e2d4574b31 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30482024-11-27T18:36:14.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c26c5fe0-fb4d-473c-832e-69e2d4574b31 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30492024-11-27T18:36:15.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f025e1c-7a62-4c66-887b-d518d392e096 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30502024-11-27T18:36:15.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f025e1c-7a62-4c66-887b-d518d392e096 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30512024-11-27T18:36:15.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f025e1c-7a62-4c66-887b-d518d392e096 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30522024-11-27T18:36:16.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6952f446-45af-4bbc-b730-8a49efdc2e80 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30532024-11-27T18:36:16.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6952f446-45af-4bbc-b730-8a49efdc2e80 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30542024-11-27T18:36:16.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6952f446-45af-4bbc-b730-8a49efdc2e80 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30552024-11-27T18:36:17.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3337dd76-c459-4ae0-b8ee-ab1a4ad1e0b2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30562024-11-27T18:36:17.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3337dd76-c459-4ae0-b8ee-ab1a4ad1e0b2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30572024-11-27T18:36:17.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3337dd76-c459-4ae0-b8ee-ab1a4ad1e0b2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30582024-11-27T18:36:18.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c309ef3-f740-469d-a55a-edf7c7cc6d14 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30592024-11-27T18:36:18.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c309ef3-f740-469d-a55a-edf7c7cc6d14 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30602024-11-27T18:36:18.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c309ef3-f740-469d-a55a-edf7c7cc6d14 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30612024-11-27T18:36:19.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ff7900-e34c-4760-8a9a-47698c28cf42 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30622024-11-27T18:36:19.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ff7900-e34c-4760-8a9a-47698c28cf42 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30632024-11-27T18:36:19.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ff7900-e34c-4760-8a9a-47698c28cf42 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30642024-11-27T18:36:20.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10cb8993-4404-4050-ba13-8e56bb7263c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30652024-11-27T18:36:20.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10cb8993-4404-4050-ba13-8e56bb7263c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30662024-11-27T18:36:20.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10cb8993-4404-4050-ba13-8e56bb7263c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30672024-11-27T18:36:21.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
30682024-11-27T18:36:21.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30692024-11-27T18:36:21.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30702024-11-27T18:36:21.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
30712024-11-27T18:36:21.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30722024-11-27T18:36:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30732024-11-27T18:36:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30742024-11-27T18:36:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30752024-11-27T18:36:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30762024-11-27T18:36:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30772024-11-27T18:36:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30782024-11-27T18:36:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.902198ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30792024-11-27T18:36:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30802024-11-27T18:36:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30812024-11-27T18:36:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30822024-11-27T18:36:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-11-27T18:36:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
30842024-11-27T18:36:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30852024-11-27T18:36:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30862024-11-27T18:36:21.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
30872024-11-27T18:36:21.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.540787ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
30882024-11-27T18:36:21.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b22f2b04-40e9-4de8-b3b1-911aa6f4b501 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30892024-11-27T18:36:21.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b22f2b04-40e9-4de8-b3b1-911aa6f4b501 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30902024-11-27T18:36:21.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b22f2b04-40e9-4de8-b3b1-911aa6f4b501 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30912024-11-27T18:36:22.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc7ced8-52fa-4acc-b1f3-e1b75a6a5535 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30922024-11-27T18:36:22.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc7ced8-52fa-4acc-b1f3-e1b75a6a5535 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30932024-11-27T18:36:22.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abc7ced8-52fa-4acc-b1f3-e1b75a6a5535 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30942024-11-27T18:36:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a8148272-6378-40e9-beee-849461528109 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
30952024-11-27T18:36:23.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a4c0ce6-da61-42d6-8dc2-07ff49f7155d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30962024-11-27T18:36:23.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a4c0ce6-da61-42d6-8dc2-07ff49f7155d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30972024-11-27T18:36:23.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a4c0ce6-da61-42d6-8dc2-07ff49f7155d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30982024-11-27T18:36:24.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38bc3732-be8e-4454-bc53-284ced763d8a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
30992024-11-27T18:36:24.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38bc3732-be8e-4454-bc53-284ced763d8a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31002024-11-27T18:36:24.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38bc3732-be8e-4454-bc53-284ced763d8a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31012024-11-27T18:36:25.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ac09ccc3-1297-41f1-bba9-e937a447f001 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31022024-11-27T18:36:25.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ac09ccc3-1297-41f1-bba9-e937a447f001 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31032024-11-27T18:36:25.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ac09ccc3-1297-41f1-bba9-e937a447f001 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31042024-11-27T18:36:26.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ae5cc5-4ebe-422c-87ee-7ddc334bdda7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31052024-11-27T18:36:26.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ae5cc5-4ebe-422c-87ee-7ddc334bdda7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31062024-11-27T18:36:26.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ae5cc5-4ebe-422c-87ee-7ddc334bdda7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31072024-11-27T18:36:27.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8289ee2-554c-4d6d-a341-da97554e5ac6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31082024-11-27T18:36:27.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8289ee2-554c-4d6d-a341-da97554e5ac6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31092024-11-27T18:36:27.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8289ee2-554c-4d6d-a341-da97554e5ac6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31102024-11-27T18:36:28.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 21815793-a757-40b8-916c-5d00d6d37afb roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
31112024-11-27T18:36:28.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 21815793-a757-40b8-916c-5d00d6d37afb resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
31122024-11-27T18:36:28.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 21815793-a757-40b8-916c-5d00d6d37afb response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
31132024-11-27T18:36:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6efa9a15-7cff-40c1-bd55-2e0b1d349b9d roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
31142024-11-27T18:36:28.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6efa9a15-7cff-40c1-bd55-2e0b1d349b9d resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
31152024-11-27T18:36:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6efa9a15-7cff-40c1-bd55-2e0b1d349b9d response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
31162024-11-27T18:36:28.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e5225245-eb47-49a7-8a74-57804741c830 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31172024-11-27T18:36:28.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e5225245-eb47-49a7-8a74-57804741c830 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31182024-11-27T18:36:28.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e5225245-eb47-49a7-8a74-57804741c830 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31192024-11-27T18:36:29.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f6c54eec-0f0c-4094-b354-24f9bd882f63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31202024-11-27T18:36:29.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f6c54eec-0f0c-4094-b354-24f9bd882f63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31212024-11-27T18:36:29.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f6c54eec-0f0c-4094-b354-24f9bd882f63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31222024-11-27T18:36:30.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 87d652fe-6829-40d1-8781-b6f24f667d63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31232024-11-27T18:36:30.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 87d652fe-6829-40d1-8781-b6f24f667d63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31242024-11-27T18:36:30.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 87d652fe-6829-40d1-8781-b6f24f667d63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
31252024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
31262024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31272024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31282024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
31292024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31302024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31312024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31322024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31332024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
31342024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31352024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31362024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
31372024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
31382024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31392024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
31402024-11-27T18:36:31.390ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
31412024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31422024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31432024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.65\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
31442024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
31452024-11-27T18:36:31.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31462024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
31472024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31482024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31492024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31502024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31512024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31522024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31532024-11-27T18:36:31.390ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
31542024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
31552024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31562024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
31572024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
31582024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
31592024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31602024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31612024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
31622024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
31632024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31642024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31652024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
31662024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31672024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31682024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31692024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
31702024-11-27T18:36:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31712024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31722024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
31732024-11-27T18:36:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:26:31.390714995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31742024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31752024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
31762024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31772024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31782024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31792024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31802024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31812024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31822024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31832024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31842024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31852024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
31862024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31872024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31882024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31892024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
31902024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31912024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31922024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31932024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31942024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31952024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31962024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31972024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31982024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31992024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32002024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32012024-11-27T18:36:31.391ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 389459832 } })
32022024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32032024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32042024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32052024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32062024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32072024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32082024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32092024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32102024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32112024-11-27T18:36:31.391ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 389849397 } })
32122024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32132024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32142024-11-27T18:36:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.34864ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32152024-11-27T18:36:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32162024-11-27T18:36:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.059006ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32172024-11-27T18:36:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32182024-11-27T18:36:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32192024-11-27T18:36:31.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32202024-11-27T18:36:31.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32212024-11-27T18:36:31.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32222024-11-27T18:36:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32232024-11-27T18:36:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.109586ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
32242024-11-27T18:36:31.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32252024-11-27T18:36:31.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262024-11-27T18:36:31.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32272024-11-27T18:36:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32282024-11-27T18:36:31.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32292024-11-27T18:36:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32302024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32312024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32322024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32332024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32342024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32352024-11-27T18:36:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32362024-11-27T18:36:31.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.940862ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32372024-11-27T18:36:31.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32382024-11-27T18:36:31.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392024-11-27T18:36:31.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32402024-11-27T18:36:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32412024-11-27T18:36:31.405ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:26:31.390714995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32422024-11-27T18:36:31.405ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.207445ms iteration = 3 status = {"expiration":"2024-11-27T18:26:31.390714995Z","pruned":[]}
32432024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32442024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32452024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32462024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32472024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32482024-11-27T18:36:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32492024-11-27T18:36:31.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32502024-11-27T18:36:31.408ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 406513175 } })
32512024-11-27T18:36:31.408ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32522024-11-27T18:36:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32532024-11-27T18:36:31.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32542024-11-27T18:36:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32552024-11-27T18:36:31.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32562024-11-27T18:36:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32572024-11-27T18:36:31.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32582024-11-27T18:36:31.411ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32592024-11-27T18:36:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32602024-11-27T18:36:31.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32612024-11-27T18:36:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32622024-11-27T18:36:31.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32632024-11-27T18:36:31.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32642024-11-27T18:36:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32652024-11-27T18:36:31.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32662024-11-27T18:36:31.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32672024-11-27T18:36:31.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 421388235 } })
32682024-11-27T18:36:31.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
32692024-11-27T18:36:31.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32702024-11-27T18:36:31.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32712024-11-27T18:36:31.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32722024-11-27T18:36:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
32732024-11-27T18:36:31.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32742024-11-27T18:36:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32752024-11-27T18:36:31.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-11-27T18:36:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32772024-11-27T18:36:31.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32782024-11-27T18:36:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32792024-11-27T18:36:31.434ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32802024-11-27T18:36:31.434ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32812024-11-27T18:36:31.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32822024-11-27T18:36:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32832024-11-27T18:36:31.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32842024-11-27T18:36:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32852024-11-27T18:36:31.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32862024-11-27T18:36:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32872024-11-27T18:36:31.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32882024-11-27T18:36:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32892024-11-27T18:36:31.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32902024-11-27T18:36:31.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32912024-11-27T18:36:31.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32922024-11-27T18:36:31.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932024-11-27T18:36:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32942024-11-27T18:36:31.448ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32952024-11-27T18:36:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32962024-11-27T18:36:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32972024-11-27T18:36:31.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32982024-11-27T18:36:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32992024-11-27T18:36:31.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33002024-11-27T18:36:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33012024-11-27T18:36:31.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.012214ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
33022024-11-27T18:36:31.456ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33032024-11-27T18:36:31.456ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33042024-11-27T18:36:31.456ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.996463ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33052024-11-27T18:36:31.458ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33062024-11-27T18:36:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33072024-11-27T18:36:31.467ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33082024-11-27T18:36:31.467ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33092024-11-27T18:36:31.467ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.040822ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33102024-11-27T18:36:31.471ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33112024-11-27T18:36:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33122024-11-27T18:36:31.488ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33132024-11-27T18:36:31.488ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33142024-11-27T18:36:31.488ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33152024-11-27T18:36:31.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33162024-11-27T18:36:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33172024-11-27T18:36:31.489ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 98.663323ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33182024-11-27T18:36:31.491ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33192024-11-27T18:36:31.491ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33202024-11-27T18:36:31.491ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33212024-11-27T18:36:31.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33222024-11-27T18:36:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33232024-11-27T18:36:31.505ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33242024-11-27T18:36:31.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33252024-11-27T18:36:31.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 509832586 } })
33262024-11-27T18:36:31.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33272024-11-27T18:36:31.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
33282024-11-27T18:36:31.554ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33292024-11-27T18:36:31.554ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfcfbbd1-b328-4acb-9ba4-3a3b5ac4b886", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
33302024-11-27T18:36:31.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33312024-11-27T18:36:31.555ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33322024-11-27T18:36:31.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33332024-11-27T18:36:31.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33342024-11-27T18:36:31.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
33352024-11-27T18:36:31.573ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33362024-11-27T18:36:31.574ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c4aeb1-737b-4378-90b5-9afa1755222a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
33372024-11-27T18:36:31.574ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33382024-11-27T18:36:31.576ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
33392024-11-27T18:36:31.599ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33402024-11-27T18:36:31.599ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33412024-11-27T18:36:31.600ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e861b39-1dbc-4a5c-8949-1111abfc513a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
33422024-11-27T18:36:31.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33432024-11-27T18:36:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33442024-11-27T18:36:31.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33452024-11-27T18:36:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33462024-11-27T18:36:31.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 215.582445ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33472024-11-27T18:36:31.606ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33482024-11-27T18:36:31.606ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33492024-11-27T18:36:31.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33502024-11-27T18:36:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33512024-11-27T18:36:31.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33522024-11-27T18:36:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33532024-11-27T18:36:31.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-11-27T18:36:31.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
33552024-11-27T18:36:31.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 230.04546ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
33562024-11-27T18:36:31.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
33572024-11-27T18:36:31.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33582024-11-27T18:36:31.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33592024-11-27T18:36:31.634ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 243.912775ms iteration = 5 status = 0
33602024-11-27T18:36:31.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612024-11-27T18:36:31.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 271.061187ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33622024-11-27T18:36:31.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 270.320456ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33632024-11-27T18:36:31.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33642024-11-27T18:36:31.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33652024-11-27T18:36:31.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33662024-11-27T18:36:31.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33672024-11-27T18:36:31.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 276.014532ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33682024-11-27T18:36:31.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692024-11-27T18:36:31.667ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33702024-11-27T18:36:31.667ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33712024-11-27T18:36:31.667ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 276.699431ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33722024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33732024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33742024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33752024-11-27T18:36:31.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33762024-11-27T18:36:31.673ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "21a2938c-b2d5-47bf-a728-33612030e725", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33772024-11-27T18:36:31.673ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33782024-11-27T18:36:31.674ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f7fe5da2-20d5-425f-86fb-77d84856ace2", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33792024-11-27T18:36:31.674ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33802024-11-27T18:36:31.675ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33812024-11-27T18:36:31.675ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 285.423991ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33822024-11-27T18:36:31.677ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33832024-11-27T18:36:31.677ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 285.771565ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33842024-11-27T18:36:31.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
33852024-11-27T18:36:31.687ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33862024-11-27T18:36:31.688ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cb273a2-4570-40d0-93df-e7394c06ebd9", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
33872024-11-27T18:36:31.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33882024-11-27T18:36:31.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33892024-11-27T18:36:31.697ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33902024-11-27T18:36:31.697ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33912024-11-27T18:36:31.697ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d67f2f32-96ee-4280-aef6-3803f15d7c16", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
33922024-11-27T18:36:31.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33932024-11-27T18:36:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33942024-11-27T18:36:31.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33952024-11-27T18:36:31.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33962024-11-27T18:36:31.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33972024-11-27T18:36:31.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33982024-11-27T18:36:31.707ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33992024-11-27T18:36:31.708ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34002024-11-27T18:36:31.708ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0bf523dd-8586-4ff3-aaac-3be7ddc5eea8", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
34012024-11-27T18:36:31.710ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.888161ms iteration = 5 status = {}
34022024-11-27T18:36:31.725ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34032024-11-27T18:36:31.725ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2e4726-f5ab-453a-8a4e-97e63318236e", "content-length": "1", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
34042024-11-27T18:36:31.727ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34052024-11-27T18:36:31.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34062024-11-27T18:36:31.729ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 338.341805ms iteration = 5 status = null
34072024-11-27T18:36:31.732ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34082024-11-27T18:36:31.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 341.432081ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34092024-11-27T18:36:31.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34102024-11-27T18:36:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34112024-11-27T18:36:31.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122024-11-27T18:36:31.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34132024-11-27T18:36:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34142024-11-27T18:36:31.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34152024-11-27T18:36:31.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34162024-11-27T18:36:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34172024-11-27T18:36:31.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-11-27T18:36:31.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34192024-11-27T18:36:31.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34202024-11-27T18:36:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34212024-11-27T18:36:31.765ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34222024-11-27T18:36:31.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8807f055-cb0b-477a-b986-d7f9d75eb138", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34232024-11-27T18:36:31.766ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34242024-11-27T18:36:31.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a5900f6c-ddee-4d88-9980-265b86c113e7", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34252024-11-27T18:36:31.768ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34262024-11-27T18:36:31.770ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "391ad8b7-0934-4bbf-845c-aae823a50e48", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34272024-11-27T18:36:31.770ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34282024-11-27T18:36:31.773ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34292024-11-27T18:36:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 383.001026ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34302024-11-27T18:36:31.785ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34312024-11-27T18:36:31.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34322024-11-27T18:36:31.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34332024-11-27T18:36:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34342024-11-27T18:36:31.788ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 397.521212ms iteration = 5 status = {}
34352024-11-27T18:36:31.814ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34362024-11-27T18:36:31.814ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34372024-11-27T18:36:31.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34382024-11-27T18:36:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34392024-11-27T18:36:31.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34402024-11-27T18:36:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34412024-11-27T18:36:31.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34422024-11-27T18:36:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34432024-11-27T18:36:31.822ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34442024-11-27T18:36:31.822ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
34452024-11-27T18:36:31.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34462024-11-27T18:36:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34472024-11-27T18:36:31.823ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34482024-11-27T18:36:31.823ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34492024-11-27T18:36:31.823ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
34502024-11-27T18:36:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 432.743723ms iteration = 3 status = {"generation":1}
34512024-11-27T18:36:31.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-11-27T18:36:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34532024-11-27T18:36:31.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34542024-11-27T18:36:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34552024-11-27T18:36:31.830ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
34562024-11-27T18:36:31.830ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34572024-11-27T18:36:31.830ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
34582024-11-27T18:36:31.830ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 439.774798ms iteration = 3 status = {"generation":2}
34592024-11-27T18:36:31.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34602024-11-27T18:36:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34612024-11-27T18:36:31.838ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
34622024-11-27T18:36:31.838ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 447.721576ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34632024-11-27T18:36:31.839ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
34642024-11-27T18:36:31.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34652024-11-27T18:36:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34662024-11-27T18:36:31.839ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 448.760332ms iteration = 7 status = {"physical_disks_added":0}
34672024-11-27T18:36:31.864ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34682024-11-27T18:36:31.865ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c746139e-dc2f-4123-826a-bdc82a29d86e", "content-length": "691", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
34692024-11-27T18:36:31.865ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
34702024-11-27T18:36:31.865ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
34712024-11-27T18:36:31.865ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
34722024-11-27T18:36:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.563629ms iteration = 5 status = {}
34732024-11-27T18:36:31.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cee7408c-dd02-47fb-9ead-f603548aa868 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
34742024-11-27T18:36:31.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cee7408c-dd02-47fb-9ead-f603548aa868 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
34752024-11-27T18:36:31.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cee7408c-dd02-47fb-9ead-f603548aa868 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
34762024-11-27T18:36:32.047ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34772024-11-27T18:36:32.047ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f06a15f2-58d7-489d-99f8-cc77e29e97d2", "content-length": "134", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
34782024-11-27T18:36:32.047ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34792024-11-27T18:36:32.047ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
34802024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34812024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34822024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34832024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34842024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34852024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34862024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34872024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34882024-11-27T18:36:32.048ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
34892024-11-27T18:36:32.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34902024-11-27T18:36:32.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34912024-11-27T18:36:32.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34922024-11-27T18:36:32.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfbaaf8a-fb5d-4b9b-9c78-526ed5a0b8d9", "content-length": "2", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
34932024-11-27T18:36:32.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34942024-11-27T18:36:32.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cc11e3a-bd41-44c3-9251-5c5261993736", "content-length": "52", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
34952024-11-27T18:36:32.051ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
34962024-11-27T18:36:32.051ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34972024-11-27T18:36:32.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0839bb81-4f9c-4baa-9693-acebf83b78b3", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
34982024-11-27T18:36:32.168ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
34992024-11-27T18:36:32.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35002024-11-27T18:36:32.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a12d8ad-7370-49f7-a0bb-ca29b37ab29b", "content-length": "682", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
35012024-11-27T18:36:32.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35022024-11-27T18:36:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35032024-11-27T18:36:32.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35042024-11-27T18:36:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35052024-11-27T18:36:32.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35062024-11-27T18:36:32.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35072024-11-27T18:36:32.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = d855e81f-b95b-45e3-9666-d9840840cec7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
35082024-11-27T18:36:32.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = d855e81f-b95b-45e3-9666-d9840840cec7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
35092024-11-27T18:36:32.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = d855e81f-b95b-45e3-9666-d9840840cec7 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
35102024-11-27T18:36:32.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35112024-11-27T18:36:32.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35122024-11-27T18:36:32.298ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 907.582112ms iteration = 5 status = {}
35132024-11-27T18:36:32.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c146a8e6-39b3-44ec-a0f2-cb1f82a50326 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35142024-11-27T18:36:32.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c146a8e6-39b3-44ec-a0f2-cb1f82a50326 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35152024-11-27T18:36:32.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c146a8e6-39b3-44ec-a0f2-cb1f82a50326 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35162024-11-27T18:36:33.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 08661e55-0c2d-40e4-af2e-a2b4451b0347 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
35172024-11-27T18:36:33.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 908c07ba-977e-4004-afac-2a78efe29e4a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35182024-11-27T18:36:33.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 908c07ba-977e-4004-afac-2a78efe29e4a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35192024-11-27T18:36:33.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 908c07ba-977e-4004-afac-2a78efe29e4a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35202024-11-27T18:36:34.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2dbc2bf6-5a79-4e12-aabc-7462a492d956 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35212024-11-27T18:36:34.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2dbc2bf6-5a79-4e12-aabc-7462a492d956 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35222024-11-27T18:36:34.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2dbc2bf6-5a79-4e12-aabc-7462a492d956 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35232024-11-27T18:36:35.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccbcb214-7772-4c09-bbdb-020aa261f7ba roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35242024-11-27T18:36:35.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccbcb214-7772-4c09-bbdb-020aa261f7ba resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35252024-11-27T18:36:35.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccbcb214-7772-4c09-bbdb-020aa261f7ba response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35262024-11-27T18:36:37.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 127bf595-f360-4ef7-b77e-6075a0a82f5e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35272024-11-27T18:36:37.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 127bf595-f360-4ef7-b77e-6075a0a82f5e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35282024-11-27T18:36:37.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 127bf595-f360-4ef7-b77e-6075a0a82f5e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35292024-11-27T18:36:38.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ab57a5-3536-440b-add4-7271f7779473 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35302024-11-27T18:36:38.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ab57a5-3536-440b-add4-7271f7779473 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35312024-11-27T18:36:38.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 47ab57a5-3536-440b-add4-7271f7779473 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35322024-11-27T18:36:39.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6f3e966-9011-4560-9e67-9d1965111e26 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35332024-11-27T18:36:39.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6f3e966-9011-4560-9e67-9d1965111e26 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35342024-11-27T18:36:39.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6f3e966-9011-4560-9e67-9d1965111e26 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35352024-11-27T18:36:40.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c0e78a0-8c51-4744-ad8d-a7937183010f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35362024-11-27T18:36:40.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c0e78a0-8c51-4744-ad8d-a7937183010f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35372024-11-27T18:36:40.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c0e78a0-8c51-4744-ad8d-a7937183010f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35382024-11-27T18:36:41.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 174ccd9b-0e02-4ce1-920d-04267da78da0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35392024-11-27T18:36:41.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 174ccd9b-0e02-4ce1-920d-04267da78da0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35402024-11-27T18:36:41.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 174ccd9b-0e02-4ce1-920d-04267da78da0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35412024-11-27T18:36:41.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
35422024-11-27T18:36:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35432024-11-27T18:36:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35442024-11-27T18:36:41.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
35452024-11-27T18:36:41.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35462024-11-27T18:36:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35472024-11-27T18:36:41.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35482024-11-27T18:36:41.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35492024-11-27T18:36:41.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35502024-11-27T18:36:41.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35512024-11-27T18:36:41.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35522024-11-27T18:36:41.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35532024-11-27T18:36:41.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35542024-11-27T18:36:41.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35552024-11-27T18:36:41.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.846124ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35562024-11-27T18:36:41.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572024-11-27T18:36:41.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
35582024-11-27T18:36:41.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35592024-11-27T18:36:41.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35602024-11-27T18:36:41.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
35612024-11-27T18:36:41.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.618611ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
35622024-11-27T18:36:42.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f03a8478-dd9d-45b6-a085-1967c2d0b5b2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35632024-11-27T18:36:42.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f03a8478-dd9d-45b6-a085-1967c2d0b5b2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35642024-11-27T18:36:42.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f03a8478-dd9d-45b6-a085-1967c2d0b5b2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35652024-11-27T18:36:43.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5940c139-ebec-49f5-9a15-8d9dd2d484ac roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35662024-11-27T18:36:43.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5940c139-ebec-49f5-9a15-8d9dd2d484ac resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35672024-11-27T18:36:43.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5940c139-ebec-49f5-9a15-8d9dd2d484ac response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35682024-11-27T18:36:43.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 85d28de0-5c1d-4bd7-b29a-1249d857a2f3 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
35692024-11-27T18:36:44.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7e3a00-b8ff-4e7d-bf9b-5effd772eca6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35702024-11-27T18:36:44.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7e3a00-b8ff-4e7d-bf9b-5effd772eca6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35712024-11-27T18:36:44.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7e3a00-b8ff-4e7d-bf9b-5effd772eca6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35722024-11-27T18:36:45.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee9f7f22-9a2f-4452-87c8-dc13c91991e7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35732024-11-27T18:36:45.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee9f7f22-9a2f-4452-87c8-dc13c91991e7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35742024-11-27T18:36:45.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee9f7f22-9a2f-4452-87c8-dc13c91991e7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35752024-11-27T18:36:46.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ab07e2c-c30c-4482-8970-4b7a35e48cd4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35762024-11-27T18:36:46.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ab07e2c-c30c-4482-8970-4b7a35e48cd4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35772024-11-27T18:36:46.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ab07e2c-c30c-4482-8970-4b7a35e48cd4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35782024-11-27T18:36:47.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e94c836-bbc1-4ee8-a83a-125fdf21dfc8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35792024-11-27T18:36:47.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e94c836-bbc1-4ee8-a83a-125fdf21dfc8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35802024-11-27T18:36:47.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e94c836-bbc1-4ee8-a83a-125fdf21dfc8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35812024-11-27T18:36:48.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887bdf28-8ce9-446e-ba68-d06cb38cbaa9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35822024-11-27T18:36:48.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887bdf28-8ce9-446e-ba68-d06cb38cbaa9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35832024-11-27T18:36:48.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887bdf28-8ce9-446e-ba68-d06cb38cbaa9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35842024-11-27T18:36:49.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a2243df5-6bfb-4701-86ef-804ee91dacb4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35852024-11-27T18:36:49.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a2243df5-6bfb-4701-86ef-804ee91dacb4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35862024-11-27T18:36:49.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a2243df5-6bfb-4701-86ef-804ee91dacb4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35872024-11-27T18:36:50.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a248b64-1b01-4be7-9212-77f741bf6cd1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35882024-11-27T18:36:50.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a248b64-1b01-4be7-9212-77f741bf6cd1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35892024-11-27T18:36:50.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a248b64-1b01-4be7-9212-77f741bf6cd1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35902024-11-27T18:36:51.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2366723e-c990-4e24-9f2f-aec369e0ed57 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35912024-11-27T18:36:51.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2366723e-c990-4e24-9f2f-aec369e0ed57 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35922024-11-27T18:36:51.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2366723e-c990-4e24-9f2f-aec369e0ed57 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
35932024-11-27T18:36:51.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
35942024-11-27T18:36:51.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35952024-11-27T18:36:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35962024-11-27T18:36:51.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
35972024-11-27T18:36:51.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35982024-11-27T18:36:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35992024-11-27T18:36:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36002024-11-27T18:36:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36012024-11-27T18:36:51.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.402231ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36022024-11-27T18:36:51.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032024-11-27T18:36:51.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36042024-11-27T18:36:51.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36052024-11-27T18:36:51.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36062024-11-27T18:36:51.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36072024-11-27T18:36:51.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36082024-11-27T18:36:51.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092024-11-27T18:36:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
36102024-11-27T18:36:51.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36112024-11-27T18:36:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36122024-11-27T18:36:51.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
36132024-11-27T18:36:51.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.047011ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
36142024-11-27T18:36:52.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 917b87c4-c8c6-41ca-901d-f386716ef953 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36152024-11-27T18:36:52.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 917b87c4-c8c6-41ca-901d-f386716ef953 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36162024-11-27T18:36:52.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 917b87c4-c8c6-41ca-901d-f386716ef953 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36172024-11-27T18:36:53.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8238eefd-d525-4178-91bc-841f0e378c7e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36182024-11-27T18:36:53.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8238eefd-d525-4178-91bc-841f0e378c7e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36192024-11-27T18:36:53.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8238eefd-d525-4178-91bc-841f0e378c7e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36202024-11-27T18:36:53.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 920 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 26f11c20-9771-452c-9aab-403fdd1ef527 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
36212024-11-27T18:36:54.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 67918f2f-9c6d-44ef-bcb0-8c1142dd90ce roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36222024-11-27T18:36:54.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 67918f2f-9c6d-44ef-bcb0-8c1142dd90ce resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36232024-11-27T18:36:54.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 67918f2f-9c6d-44ef-bcb0-8c1142dd90ce response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36242024-11-27T18:36:55.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07e16204-87b8-4b62-a8fe-b93469e3ab85 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36252024-11-27T18:36:55.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07e16204-87b8-4b62-a8fe-b93469e3ab85 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36262024-11-27T18:36:55.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07e16204-87b8-4b62-a8fe-b93469e3ab85 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36272024-11-27T18:36:56.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93398ac2-818f-4c52-a210-34dfca143df6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36282024-11-27T18:36:56.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93398ac2-818f-4c52-a210-34dfca143df6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36292024-11-27T18:36:56.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93398ac2-818f-4c52-a210-34dfca143df6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36302024-11-27T18:36:57.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f2116cb9-9910-40de-8d63-dadc2ab12df7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36312024-11-27T18:36:57.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f2116cb9-9910-40de-8d63-dadc2ab12df7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36322024-11-27T18:36:57.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f2116cb9-9910-40de-8d63-dadc2ab12df7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36332024-11-27T18:36:58.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977ea168-e25b-44ad-a369-11e76a5c7c30 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36342024-11-27T18:36:58.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977ea168-e25b-44ad-a369-11e76a5c7c30 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36352024-11-27T18:36:58.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977ea168-e25b-44ad-a369-11e76a5c7c30 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36362024-11-27T18:36:59.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887b433c-5cb1-43a5-978c-68e7115a787e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36372024-11-27T18:36:59.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887b433c-5cb1-43a5-978c-68e7115a787e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36382024-11-27T18:36:59.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 887b433c-5cb1-43a5-978c-68e7115a787e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36392024-11-27T18:37:00.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c2de4a3e-317e-4e10-8f6d-18d17bd63c98 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36402024-11-27T18:37:00.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c2de4a3e-317e-4e10-8f6d-18d17bd63c98 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36412024-11-27T18:37:00.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c2de4a3e-317e-4e10-8f6d-18d17bd63c98 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
36422024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
36432024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
36442024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36452024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36462024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
36472024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
36482024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36492024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
36502024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
36512024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36522024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36532024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36542024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36552024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36562024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36572024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
36582024-11-27T18:37:01.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36592024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
36602024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36612024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
36622024-11-27T18:37:01.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36632024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36642024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36652024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
36662024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36672024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
36682024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36692024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
36702024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36712024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
36722024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
36732024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36742024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36752024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
36762024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36772024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36782024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36792024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36802024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36812024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36822024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36832024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36842024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36852024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36862024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36872024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36882024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36892024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36902024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36912024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36922024-11-27T18:37:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36932024-11-27T18:37:01.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-11-27T18:37:01.394ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.319369ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36952024-11-27T18:37:01.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962024-11-27T18:37:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36972024-11-27T18:37:01.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36982024-11-27T18:37:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36992024-11-27T18:37:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37002024-11-27T18:37:01.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37012024-11-27T18:37:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37022024-11-27T18:37:01.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37032024-11-27T18:37:01.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 397564582 } })
37042024-11-27T18:37:01.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37052024-11-27T18:37:01.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37072024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37082024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37092024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37102024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37112024-11-27T18:37:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37122024-11-27T18:37:01.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37132024-11-27T18:37:01.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37142024-11-27T18:37:01.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 404193600 } })
37152024-11-27T18:37:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37162024-11-27T18:37:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37172024-11-27T18:37:01.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
37182024-11-27T18:37:01.410ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 408637106 } })
37192024-11-27T18:37:01.411ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37202024-11-27T18:37:01.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.864229ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
37212024-11-27T18:37:01.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37222024-11-27T18:37:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37232024-11-27T18:37:01.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-11-27T18:37:01.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37252024-11-27T18:37:01.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37262024-11-27T18:37:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37272024-11-27T18:37:01.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37282024-11-27T18:37:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37292024-11-27T18:37:01.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37302024-11-27T18:37:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37312024-11-27T18:37:01.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37322024-11-27T18:37:01.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37332024-11-27T18:37:01.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37342024-11-27T18:37:01.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37352024-11-27T18:37:01.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.122677ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
37362024-11-27T18:37:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37372024-11-27T18:37:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37382024-11-27T18:37:01.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392024-11-27T18:37:01.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37402024-11-27T18:37:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37412024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37422024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37432024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37442024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37452024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37462024-11-27T18:37:01.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37472024-11-27T18:37:01.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37482024-11-27T18:37:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37492024-11-27T18:37:01.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37502024-11-27T18:37:01.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37512024-11-27T18:37:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37522024-11-27T18:37:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37532024-11-27T18:37:01.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37542024-11-27T18:37:01.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37552024-11-27T18:37:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37562024-11-27T18:37:01.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37572024-11-27T18:37:01.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
37582024-11-27T18:37:01.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37592024-11-27T18:37:01.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37602024-11-27T18:37:01.459ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37612024-11-27T18:37:01.459ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.205682ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37622024-11-27T18:37:01.468ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
37632024-11-27T18:37:01.468ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.666631ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
37642024-11-27T18:37:01.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37652024-11-27T18:37:01.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.64447ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37662024-11-27T18:37:01.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
37672024-11-27T18:37:01.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37682024-11-27T18:37:01.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37692024-11-27T18:37:01.477ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37702024-11-27T18:37:01.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37712024-11-27T18:37:01.479ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.171587ms iteration = 6 status = 0
37722024-11-27T18:37:01.482ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37732024-11-27T18:37:01.482ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37742024-11-27T18:37:01.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37752024-11-27T18:37:01.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37762024-11-27T18:37:01.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.240572ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37772024-11-27T18:37:01.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.284031ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37782024-11-27T18:37:01.495ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37792024-11-27T18:37:01.495ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37802024-11-27T18:37:01.495ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db272c84-5e11-4790-956b-2f4ad22799a8", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
37812024-11-27T18:37:01.495ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37822024-11-27T18:37:01.497ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37832024-11-27T18:37:01.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37842024-11-27T18:37:01.500ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37852024-11-27T18:37:01.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
37862024-11-27T18:37:01.500ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37872024-11-27T18:37:01.500ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11a1fe24-fb8a-4d7c-b149-8b7111517315", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
37882024-11-27T18:37:01.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37892024-11-27T18:37:01.500ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4445b71a-a0cc-4f53-b6ff-2091c2b1fbfd", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
37902024-11-27T18:37:01.501ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37912024-11-27T18:37:01.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
37922024-11-27T18:37:01.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37932024-11-27T18:37:01.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37942024-11-27T18:37:01.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37952024-11-27T18:37:01.511ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37962024-11-27T18:37:01.511ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37972024-11-27T18:37:01.511ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.832791ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37982024-11-27T18:37:01.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.715294ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37992024-11-27T18:37:01.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 84113d0b-60cd-4cbe-967d-79204f33e314 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38002024-11-27T18:37:01.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 84113d0b-60cd-4cbe-967d-79204f33e314 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38012024-11-27T18:37:01.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 84113d0b-60cd-4cbe-967d-79204f33e314 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38022024-11-27T18:37:01.565ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.538837ms iteration = 8 status = {"physical_disks_added":0}
38032024-11-27T18:37:01.642ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38042024-11-27T18:37:01.642ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38052024-11-27T18:37:01.643ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "98f56aa0-2963-4058-9218-26f9043cd5f5", "content-length": "372", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38062024-11-27T18:37:01.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38072024-11-27T18:37:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38082024-11-27T18:37:01.692ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38092024-11-27T18:37:01.693ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b87c5bf4-5493-4ec1-bd72-ac17addd080d", "content-length": "1", "date": "Wed, 27 Nov 2024 18:37:00 GMT"} })
38102024-11-27T18:37:01.693ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38112024-11-27T18:37:01.693ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38122024-11-27T18:37:01.693ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fc53fd8a-317e-4297-a90e-caaa9eb75450", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38132024-11-27T18:37:01.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38142024-11-27T18:37:01.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38152024-11-27T18:37:01.695ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38162024-11-27T18:37:01.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38172024-11-27T18:37:01.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38182024-11-27T18:37:01.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38192024-11-27T18:37:01.697ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.631365ms iteration = 6 status = null
38202024-11-27T18:37:01.697ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.062231ms iteration = 6 status = {}
38212024-11-27T18:37:01.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38222024-11-27T18:37:01.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38232024-11-27T18:37:01.702ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38242024-11-27T18:37:01.702ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38252024-11-27T18:37:01.703ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30d804be-1aec-4861-8fe7-796ab4aad045", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38262024-11-27T18:37:01.705ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 314.299069ms iteration = 6 status = {}
38272024-11-27T18:37:01.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38282024-11-27T18:37:01.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38292024-11-27T18:37:01.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38302024-11-27T18:37:01.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38312024-11-27T18:37:01.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38322024-11-27T18:37:01.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38332024-11-27T18:37:01.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38342024-11-27T18:37:01.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38352024-11-27T18:37:01.731ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
38362024-11-27T18:37:01.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38372024-11-27T18:37:01.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38382024-11-27T18:37:01.741ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38392024-11-27T18:37:01.741ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c759f31b-ca96-4000-a276-cb8073600264", "content-length": "134", "date": "Wed, 27 Nov 2024 18:37:00 GMT"} })
38402024-11-27T18:37:01.741ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38412024-11-27T18:37:01.741ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
38422024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38432024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38442024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38452024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38462024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38472024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38482024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38492024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38502024-11-27T18:37:01.742ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
38512024-11-27T18:37:01.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38522024-11-27T18:37:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38532024-11-27T18:37:01.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38542024-11-27T18:37:01.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "09ab824a-15ce-415b-8c52-c0ce8c383bf8", "content-length": "2", "date": "Wed, 27 Nov 2024 18:37:00 GMT"} })
38552024-11-27T18:37:01.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38562024-11-27T18:37:01.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa48ad22-1db5-47cd-8ad7-d2f9649feca5", "content-length": "52", "date": "Wed, 27 Nov 2024 18:37:00 GMT"} })
38572024-11-27T18:37:01.744ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
38582024-11-27T18:37:01.744ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38592024-11-27T18:37:01.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38602024-11-27T18:37:01.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38612024-11-27T18:37:01.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38622024-11-27T18:37:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38632024-11-27T18:37:01.840ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1af40aef-1602-4fb1-be19-baed32bdbf54", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38642024-11-27T18:37:01.840ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
38652024-11-27T18:37:01.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38662024-11-27T18:37:01.841ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2fc3004-516f-4fcf-b6f0-55c79f47159a", "content-length": "682", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38672024-11-27T18:37:01.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38682024-11-27T18:37:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38692024-11-27T18:37:01.846ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38702024-11-27T18:37:01.847ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc05d1ce-fc39-4d8b-829a-cab4c867d96f", "content-length": "691", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
38712024-11-27T18:37:01.847ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38722024-11-27T18:37:01.847ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38732024-11-27T18:37:01.847ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38742024-11-27T18:37:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.45505ms iteration = 6 status = {}
38752024-11-27T18:37:01.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38762024-11-27T18:37:01.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38772024-11-27T18:37:01.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38782024-11-27T18:37:01.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38792024-11-27T18:37:01.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802024-11-27T18:37:01.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38812024-11-27T18:37:01.958ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 567.648103ms iteration = 6 status = {}
38822024-11-27T18:37:02.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ecd8506-6a4f-4c21-910e-21f2cc1a9ce3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
38832024-11-27T18:37:02.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ecd8506-6a4f-4c21-910e-21f2cc1a9ce3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
38842024-11-27T18:37:02.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ecd8506-6a4f-4c21-910e-21f2cc1a9ce3 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
38852024-11-27T18:37:02.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e26ec90-3a74-4608-a506-5db32809ece3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38862024-11-27T18:37:02.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e26ec90-3a74-4608-a506-5db32809ece3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38872024-11-27T18:37:02.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e26ec90-3a74-4608-a506-5db32809ece3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38882024-11-27T18:37:03.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44d3d0d8-b603-4f06-8c9d-d64cd3eff42e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38892024-11-27T18:37:03.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44d3d0d8-b603-4f06-8c9d-d64cd3eff42e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38902024-11-27T18:37:03.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44d3d0d8-b603-4f06-8c9d-d64cd3eff42e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38912024-11-27T18:37:03.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = d328c5a1-ab88-4b61-9e1c-d1caac97e453 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
38922024-11-27T18:37:04.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe251e3c-2a17-47f6-82cc-622457435993 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38932024-11-27T18:37:04.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe251e3c-2a17-47f6-82cc-622457435993 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38942024-11-27T18:37:04.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fe251e3c-2a17-47f6-82cc-622457435993 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38952024-11-27T18:37:05.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b86283f-a2e3-4783-9364-7b67b83d58de roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38962024-11-27T18:37:05.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b86283f-a2e3-4783-9364-7b67b83d58de resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38972024-11-27T18:37:05.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b86283f-a2e3-4783-9364-7b67b83d58de response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38982024-11-27T18:37:06.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c333018-cc40-4a9b-98b3-5866f4dfd718 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
38992024-11-27T18:37:06.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c333018-cc40-4a9b-98b3-5866f4dfd718 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39002024-11-27T18:37:06.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c333018-cc40-4a9b-98b3-5866f4dfd718 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39012024-11-27T18:37:07.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 540a4899-a24e-4bf6-b5d7-c4ce61e23e19 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39022024-11-27T18:37:07.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 540a4899-a24e-4bf6-b5d7-c4ce61e23e19 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39032024-11-27T18:37:07.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 540a4899-a24e-4bf6-b5d7-c4ce61e23e19 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39042024-11-27T18:37:08.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ca0df31-b76d-4280-a3ca-d22d7ac19cd0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39052024-11-27T18:37:08.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ca0df31-b76d-4280-a3ca-d22d7ac19cd0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39062024-11-27T18:37:08.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ca0df31-b76d-4280-a3ca-d22d7ac19cd0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39072024-11-27T18:37:09.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f80fe59c-c7b1-485a-aafe-4b8cbad0fe1a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39082024-11-27T18:37:09.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f80fe59c-c7b1-485a-aafe-4b8cbad0fe1a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39092024-11-27T18:37:09.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f80fe59c-c7b1-485a-aafe-4b8cbad0fe1a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39102024-11-27T18:37:10.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 757b1626-bb87-4665-8f4e-1280b701e265 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39112024-11-27T18:37:10.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 757b1626-bb87-4665-8f4e-1280b701e265 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39122024-11-27T18:37:10.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 757b1626-bb87-4665-8f4e-1280b701e265 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39132024-11-27T18:37:11.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39142024-11-27T18:37:11.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39152024-11-27T18:37:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39162024-11-27T18:37:11.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39172024-11-27T18:37:11.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39182024-11-27T18:37:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39192024-11-27T18:37:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202024-11-27T18:37:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39212024-11-27T18:37:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39222024-11-27T18:37:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39232024-11-27T18:37:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39242024-11-27T18:37:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39252024-11-27T18:37:11.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.04354ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39262024-11-27T18:37:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39272024-11-27T18:37:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282024-11-27T18:37:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-11-27T18:37:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
39302024-11-27T18:37:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312024-11-27T18:37:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39322024-11-27T18:37:11.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
39332024-11-27T18:37:11.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.047642ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
39342024-11-27T18:37:11.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 62d4da43-0f38-4ab8-be05-3ca8b232ab16 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39352024-11-27T18:37:11.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 62d4da43-0f38-4ab8-be05-3ca8b232ab16 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39362024-11-27T18:37:11.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 62d4da43-0f38-4ab8-be05-3ca8b232ab16 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39372024-11-27T18:37:12.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e235e44a-c706-49fb-bbba-51e28b8086f3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39382024-11-27T18:37:12.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e235e44a-c706-49fb-bbba-51e28b8086f3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39392024-11-27T18:37:12.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e235e44a-c706-49fb-bbba-51e28b8086f3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39402024-11-27T18:37:13.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = b6ca53f6-5cf3-416f-99d6-ae0d6c8cccc0 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
39412024-11-27T18:37:13.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31167bce-3d72-471d-988b-21751815a9a7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39422024-11-27T18:37:13.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31167bce-3d72-471d-988b-21751815a9a7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39432024-11-27T18:37:13.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31167bce-3d72-471d-988b-21751815a9a7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39442024-11-27T18:37:14.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb864c2b-cb93-49e6-90b4-1f006af89dd7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39452024-11-27T18:37:14.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb864c2b-cb93-49e6-90b4-1f006af89dd7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39462024-11-27T18:37:14.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb864c2b-cb93-49e6-90b4-1f006af89dd7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39472024-11-27T18:37:15.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c396b3d3-7768-47c3-b8c8-22bfe722e21b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39482024-11-27T18:37:15.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c396b3d3-7768-47c3-b8c8-22bfe722e21b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39492024-11-27T18:37:15.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c396b3d3-7768-47c3-b8c8-22bfe722e21b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39502024-11-27T18:37:16.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6e4caa76-0406-4c51-b48c-bde3e489345a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39512024-11-27T18:37:16.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6e4caa76-0406-4c51-b48c-bde3e489345a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39522024-11-27T18:37:16.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6e4caa76-0406-4c51-b48c-bde3e489345a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39532024-11-27T18:37:17.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea04a523-f080-4897-9fce-997565288fcb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39542024-11-27T18:37:17.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea04a523-f080-4897-9fce-997565288fcb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39552024-11-27T18:37:17.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea04a523-f080-4897-9fce-997565288fcb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39562024-11-27T18:37:18.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a1edd6eb-424e-4ece-a9c4-b0578dcd9d06 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39572024-11-27T18:37:18.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a1edd6eb-424e-4ece-a9c4-b0578dcd9d06 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39582024-11-27T18:37:18.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a1edd6eb-424e-4ece-a9c4-b0578dcd9d06 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39592024-11-27T18:37:19.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90f71d4b-19e2-41d7-a88c-442dd6006da8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39602024-11-27T18:37:19.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90f71d4b-19e2-41d7-a88c-442dd6006da8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39612024-11-27T18:37:19.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90f71d4b-19e2-41d7-a88c-442dd6006da8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39622024-11-27T18:37:20.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7928fb11-3ad9-4c59-9f97-1457580cceb7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39632024-11-27T18:37:20.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7928fb11-3ad9-4c59-9f97-1457580cceb7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39642024-11-27T18:37:20.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7928fb11-3ad9-4c59-9f97-1457580cceb7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39652024-11-27T18:37:21.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
39662024-11-27T18:37:21.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39672024-11-27T18:37:21.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39682024-11-27T18:37:21.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
39692024-11-27T18:37:21.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39702024-11-27T18:37:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39712024-11-27T18:37:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39722024-11-27T18:37:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39732024-11-27T18:37:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39742024-11-27T18:37:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39752024-11-27T18:37:21.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39762024-11-27T18:37:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39772024-11-27T18:37:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.829397ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39782024-11-27T18:37:21.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39792024-11-27T18:37:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39802024-11-27T18:37:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39812024-11-27T18:37:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
39822024-11-27T18:37:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39832024-11-27T18:37:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39842024-11-27T18:37:21.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
39852024-11-27T18:37:21.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.487248ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
39862024-11-27T18:37:21.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ebe2a5a9-33ab-4a0e-aaf7-18171ac8aa11 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39872024-11-27T18:37:21.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ebe2a5a9-33ab-4a0e-aaf7-18171ac8aa11 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39882024-11-27T18:37:21.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ebe2a5a9-33ab-4a0e-aaf7-18171ac8aa11 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39892024-11-27T18:37:22.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e04fcc-c4ae-4cbe-8fec-a4af719fb620 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39902024-11-27T18:37:22.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e04fcc-c4ae-4cbe-8fec-a4af719fb620 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39912024-11-27T18:37:22.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e04fcc-c4ae-4cbe-8fec-a4af719fb620 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39922024-11-27T18:37:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 661 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 77ab8e9e-70d0-4f21-808c-f223a974ebc8 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
39932024-11-27T18:37:23.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a88c77b7-b2a3-49eb-8238-a906c948d423 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39942024-11-27T18:37:23.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a88c77b7-b2a3-49eb-8238-a906c948d423 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39952024-11-27T18:37:23.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a88c77b7-b2a3-49eb-8238-a906c948d423 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39962024-11-27T18:37:25.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0b951ad-97ab-4900-902c-16cb551d39bc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39972024-11-27T18:37:25.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0b951ad-97ab-4900-902c-16cb551d39bc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39982024-11-27T18:37:25.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0b951ad-97ab-4900-902c-16cb551d39bc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
39992024-11-27T18:37:26.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 797470f4-b185-4682-8705-9ca60fed29ee roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40002024-11-27T18:37:26.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 797470f4-b185-4682-8705-9ca60fed29ee resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40012024-11-27T18:37:26.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 797470f4-b185-4682-8705-9ca60fed29ee response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40022024-11-27T18:37:27.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53bcc101-299b-4955-8101-20a8ca069555 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40032024-11-27T18:37:27.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53bcc101-299b-4955-8101-20a8ca069555 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40042024-11-27T18:37:27.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53bcc101-299b-4955-8101-20a8ca069555 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40052024-11-27T18:37:28.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c34c1a-724d-4e2a-9ca7-8a7621e9183a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40062024-11-27T18:37:28.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c34c1a-724d-4e2a-9ca7-8a7621e9183a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40072024-11-27T18:37:28.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c34c1a-724d-4e2a-9ca7-8a7621e9183a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40082024-11-27T18:37:29.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f42018e2-5608-4573-86c1-c0c15562bd28 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40092024-11-27T18:37:29.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f42018e2-5608-4573-86c1-c0c15562bd28 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40102024-11-27T18:37:29.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f42018e2-5608-4573-86c1-c0c15562bd28 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40112024-11-27T18:37:30.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31696dfa-ae33-4076-acdb-34565f25b3ed roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40122024-11-27T18:37:30.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31696dfa-ae33-4076-acdb-34565f25b3ed resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40132024-11-27T18:37:30.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 31696dfa-ae33-4076-acdb-34565f25b3ed response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40142024-11-27T18:37:31.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e3b9b595-ddce-4eaa-b793-8096b6da515e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40152024-11-27T18:37:31.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e3b9b595-ddce-4eaa-b793-8096b6da515e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40162024-11-27T18:37:31.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e3b9b595-ddce-4eaa-b793-8096b6da515e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
40172024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
40182024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
40192024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40202024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40212024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40222024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40232024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40242024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40252024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40262024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40272024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
40282024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40292024-11-27T18:37:31.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40302024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40312024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
40322024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
40332024-11-27T18:37:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40342024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40352024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40362024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40372024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
40382024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40392024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40402024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40412024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40422024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
40432024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40442024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
40452024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
40462024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40472024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
40482024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40492024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
40502024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40512024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
40522024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40532024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
40542024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40552024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
40562024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40572024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
40582024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
40592024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
40602024-11-27T18:37:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:27:31.391690676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40612024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40622024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
40632024-11-27T18:37:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
40642024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40652024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.56\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
40662024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40672024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40682024-11-27T18:37:31.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40692024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40702024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
40712024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40722024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
40732024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40742024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
40752024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40762024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
40772024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
40782024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40792024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
40802024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40812024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40822024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40832024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40842024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40852024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40862024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40872024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40882024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40892024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40902024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40912024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40922024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40932024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40942024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40952024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40962024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40972024-11-27T18:37:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 390368315 } })
40982024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40992024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41002024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41012024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41022024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41032024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41042024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41052024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41062024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41072024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41082024-11-27T18:37:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 390590508 } })
41092024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41102024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41112024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41122024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41132024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41142024-11-27T18:37:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.441982ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41152024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41162024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41172024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41182024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
41192024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.410581ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
41202024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41212024-11-27T18:37:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41222024-11-27T18:37:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41232024-11-27T18:37:31.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41242024-11-27T18:37:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41252024-11-27T18:37:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.74037ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41262024-11-27T18:37:31.396ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272024-11-27T18:37:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41282024-11-27T18:37:31.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41292024-11-27T18:37:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41302024-11-27T18:37:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41312024-11-27T18:37:31.398ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41322024-11-27T18:37:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41332024-11-27T18:37:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342024-11-27T18:37:31.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352024-11-27T18:37:31.401ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.766745ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41362024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41372024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41382024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41392024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41402024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41412024-11-27T18:37:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41422024-11-27T18:37:31.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 403457699 } })
41432024-11-27T18:37:31.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
41442024-11-27T18:37:31.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41452024-11-27T18:37:31.410ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41462024-11-27T18:37:31.410ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41472024-11-27T18:37:31.410ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.89672ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41482024-11-27T18:37:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41492024-11-27T18:37:31.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41502024-11-27T18:37:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41512024-11-27T18:37:31.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41522024-11-27T18:37:31.416ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:27:31.391690676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41532024-11-27T18:37:31.416ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.266735ms iteration = 4 status = {"expiration":"2024-11-27T18:27:31.391690676Z","pruned":[]}
41542024-11-27T18:37:31.417ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 415432957 } })
41552024-11-27T18:37:31.417ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
41562024-11-27T18:37:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41572024-11-27T18:37:31.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41582024-11-27T18:37:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41592024-11-27T18:37:31.420ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41602024-11-27T18:37:31.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41612024-11-27T18:37:31.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41622024-11-27T18:37:31.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41632024-11-27T18:37:31.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41642024-11-27T18:37:31.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652024-11-27T18:37:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41662024-11-27T18:37:31.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41672024-11-27T18:37:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41682024-11-27T18:37:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41692024-11-27T18:37:31.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-11-27T18:37:31.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712024-11-27T18:37:31.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41722024-11-27T18:37:31.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41732024-11-27T18:37:31.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41742024-11-27T18:37:31.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41752024-11-27T18:37:31.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41762024-11-27T18:37:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41772024-11-27T18:37:31.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41782024-11-27T18:37:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41792024-11-27T18:37:31.435ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41802024-11-27T18:37:31.435ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41812024-11-27T18:37:31.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41822024-11-27T18:37:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41832024-11-27T18:37:31.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 433927471 } })
41842024-11-27T18:37:31.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
41852024-11-27T18:37:31.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41862024-11-27T18:37:31.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41872024-11-27T18:37:31.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.324186ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
41882024-11-27T18:37:31.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892024-11-27T18:37:31.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41902024-11-27T18:37:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41912024-11-27T18:37:31.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41922024-11-27T18:37:31.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41932024-11-27T18:37:31.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41942024-11-27T18:37:31.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41952024-11-27T18:37:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41962024-11-27T18:37:31.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.686586ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41972024-11-27T18:37:31.443ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41982024-11-27T18:37:31.443ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41992024-11-27T18:37:31.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42002024-11-27T18:37:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42012024-11-27T18:37:31.445ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42022024-11-27T18:37:31.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.407402ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42032024-11-27T18:37:31.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.061656ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
42042024-11-27T18:37:31.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42052024-11-27T18:37:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42062024-11-27T18:37:31.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42072024-11-27T18:37:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42082024-11-27T18:37:31.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-11-27T18:37:31.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42102024-11-27T18:37:31.459ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42112024-11-27T18:37:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42122024-11-27T18:37:31.460ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42132024-11-27T18:37:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42142024-11-27T18:37:31.460ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152024-11-27T18:37:31.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42162024-11-27T18:37:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42172024-11-27T18:37:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42182024-11-27T18:37:31.462ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42192024-11-27T18:37:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42202024-11-27T18:37:31.462ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42212024-11-27T18:37:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42222024-11-27T18:37:31.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42232024-11-27T18:37:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42242024-11-27T18:37:31.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42252024-11-27T18:37:31.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42262024-11-27T18:37:31.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42272024-11-27T18:37:31.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42282024-11-27T18:37:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42292024-11-27T18:37:31.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-11-27T18:37:31.467ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42312024-11-27T18:37:31.467ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42322024-11-27T18:37:31.467ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.406893ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42332024-11-27T18:37:31.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42342024-11-27T18:37:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42352024-11-27T18:37:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42362024-11-27T18:37:31.505ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42372024-11-27T18:37:31.505ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42382024-11-27T18:37:31.505ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42392024-11-27T18:37:31.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42402024-11-27T18:37:31.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42412024-11-27T18:37:31.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42422024-11-27T18:37:31.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42432024-11-27T18:37:31.548ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42442024-11-27T18:37:31.548ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42452024-11-27T18:37:31.549ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07b919d8-ea95-4b24-af58-23dab6e9b26b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
42462024-11-27T18:37:31.549ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42472024-11-27T18:37:31.550ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42482024-11-27T18:37:31.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42492024-11-27T18:37:31.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42502024-11-27T18:37:31.595ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42512024-11-27T18:37:31.595ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85ebed08-c6b0-4a42-a8c9-13e0847384a3", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
42522024-11-27T18:37:31.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42532024-11-27T18:37:31.596ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42542024-11-27T18:37:31.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42552024-11-27T18:37:31.760ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 369.207102ms iteration = 7 status = {}
42562024-11-27T18:37:31.762ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42572024-11-27T18:37:31.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3aa2ea-7067-45ae-b3c7-ade9269464e6", "content-length": "1", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
42582024-11-27T18:37:31.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42592024-11-27T18:37:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42602024-11-27T18:37:31.767ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42612024-11-27T18:37:31.767ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42622024-11-27T18:37:31.768ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc400e1e-b419-47ea-b668-dca0cbb09162", "content-length": "372", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
42632024-11-27T18:37:31.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42642024-11-27T18:37:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42652024-11-27T18:37:31.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42662024-11-27T18:37:31.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42672024-11-27T18:37:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42682024-11-27T18:37:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42692024-11-27T18:37:31.774ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 382.899485ms iteration = 3 status = {"nsuccess":5}
42702024-11-27T18:37:31.776ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 385.085247ms iteration = 7 status = null
42712024-11-27T18:37:31.796ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
42722024-11-27T18:37:31.796ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42732024-11-27T18:37:31.796ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "244350ac-d524-4307-9aeb-76554d809531", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
42742024-11-27T18:37:31.796ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42752024-11-27T18:37:31.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
42762024-11-27T18:37:31.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 421.549887ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42772024-11-27T18:37:31.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782024-11-27T18:37:31.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42792024-11-27T18:37:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42802024-11-27T18:37:31.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42812024-11-27T18:37:31.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6f46a9f2-a51d-448a-a85f-791c8bb243f0", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42822024-11-27T18:37:31.815ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42832024-11-27T18:37:31.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42842024-11-27T18:37:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42852024-11-27T18:37:31.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42862024-11-27T18:37:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42872024-11-27T18:37:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42882024-11-27T18:37:31.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ac45c06-6d48-4ef9-9276-1be37693cb1a", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42892024-11-27T18:37:31.817ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42902024-11-27T18:37:31.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 426.861186ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42912024-11-27T18:37:31.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-11-27T18:37:31.820ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42932024-11-27T18:37:31.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 428.551181ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42942024-11-27T18:37:31.820ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42952024-11-27T18:37:31.820ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42962024-11-27T18:37:31.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 429.564796ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42972024-11-27T18:37:31.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42982024-11-27T18:37:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42992024-11-27T18:37:31.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43002024-11-27T18:37:31.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43012024-11-27T18:37:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
43022024-11-27T18:37:31.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43032024-11-27T18:37:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43042024-11-27T18:37:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 432.161665ms iteration = 9 status = {"physical_disks_added":0}
43052024-11-27T18:37:31.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43062024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43072024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43082024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
43092024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43102024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43112024-11-27T18:37:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43122024-11-27T18:37:31.827ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 435.80265ms iteration = 7 status = 0
43132024-11-27T18:37:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43142024-11-27T18:37:31.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43152024-11-27T18:37:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43162024-11-27T18:37:31.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43172024-11-27T18:37:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43182024-11-27T18:37:31.831ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
43192024-11-27T18:37:31.831ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43202024-11-27T18:37:31.831ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "311dcb91-7331-49e5-96b0-73fdc54db487", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
43212024-11-27T18:37:31.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43222024-11-27T18:37:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43232024-11-27T18:37:31.833ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43242024-11-27T18:37:31.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43252024-11-27T18:37:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43262024-11-27T18:37:31.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43272024-11-27T18:37:31.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
43282024-11-27T18:37:31.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 450.626119ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
43292024-11-27T18:37:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43302024-11-27T18:37:31.846ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43312024-11-27T18:37:31.846ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43322024-11-27T18:37:31.846ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e31669b-96a1-42d1-a664-915530c196b9", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
43332024-11-27T18:37:31.848ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 456.902902ms iteration = 7 status = {}
43342024-11-27T18:37:31.856ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43352024-11-27T18:37:31.856ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
43362024-11-27T18:37:31.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43372024-11-27T18:37:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43382024-11-27T18:37:31.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 471.775962ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43392024-11-27T18:37:31.866ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43402024-11-27T18:37:31.866ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43412024-11-27T18:37:31.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43422024-11-27T18:37:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43432024-11-27T18:37:31.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-11-27T18:37:31.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452024-11-27T18:37:31.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43462024-11-27T18:37:31.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43472024-11-27T18:37:31.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43482024-11-27T18:37:31.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43492024-11-27T18:37:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43502024-11-27T18:37:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43512024-11-27T18:37:31.873ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43522024-11-27T18:37:31.873ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43532024-11-27T18:37:31.873ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
43542024-11-27T18:37:31.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 482.317179ms iteration = 4 status = {"generation":1}
43552024-11-27T18:37:31.880ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43562024-11-27T18:37:31.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 489.086879ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43572024-11-27T18:37:31.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-11-27T18:37:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43592024-11-27T18:37:31.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43602024-11-27T18:37:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43612024-11-27T18:37:31.892ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
43622024-11-27T18:37:31.892ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43632024-11-27T18:37:31.892ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
43642024-11-27T18:37:31.892ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 500.757092ms iteration = 4 status = {"generation":2}
43652024-11-27T18:37:31.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43662024-11-27T18:37:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43672024-11-27T18:37:31.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43682024-11-27T18:37:31.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43692024-11-27T18:37:31.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43702024-11-27T18:37:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43712024-11-27T18:37:31.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722024-11-27T18:37:31.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43732024-11-27T18:37:31.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43742024-11-27T18:37:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43752024-11-27T18:37:31.900ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
43762024-11-27T18:37:31.900ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 508.819401ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43772024-11-27T18:37:31.947ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43782024-11-27T18:37:31.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "05d191d0-a8db-48cc-b0b1-c94eac03b051", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43792024-11-27T18:37:31.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43802024-11-27T18:37:31.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b66fe11-1086-4ef8-ad9e-53d2642fd503", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43812024-11-27T18:37:31.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43822024-11-27T18:37:31.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "98ce678a-b727-429f-98b9-b2369a8176d7", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43832024-11-27T18:37:31.952ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43842024-11-27T18:37:31.954ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43852024-11-27T18:37:31.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.753141ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43862024-11-27T18:37:32.012ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43872024-11-27T18:37:32.013ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bba0af30-4a58-432d-9e25-46a48d9af258", "content-length": "691", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
43882024-11-27T18:37:32.013ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43892024-11-27T18:37:32.013ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43902024-11-27T18:37:32.013ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43912024-11-27T18:37:32.015ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.13339ms iteration = 7 status = {}
43922024-11-27T18:37:32.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43932024-11-27T18:37:32.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43942024-11-27T18:37:32.075ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
43952024-11-27T18:37:32.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43962024-11-27T18:37:32.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43972024-11-27T18:37:32.090ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43982024-11-27T18:37:32.090ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb4c10f3-7e32-450f-a91b-01693b53c970", "content-length": "134", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
43992024-11-27T18:37:32.090ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44002024-11-27T18:37:32.090ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
44012024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44022024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44032024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44042024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44052024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44062024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44072024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44082024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44092024-11-27T18:37:32.091ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
44102024-11-27T18:37:32.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44112024-11-27T18:37:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44122024-11-27T18:37:32.094ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44132024-11-27T18:37:32.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec440153-856a-48cd-80e9-f0b3e1bce64a", "content-length": "2", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
44142024-11-27T18:37:32.094ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44152024-11-27T18:37:32.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b93029e9-47d1-4da6-9da9-4810629b0036", "content-length": "52", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
44162024-11-27T18:37:32.094ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
44172024-11-27T18:37:32.094ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44182024-11-27T18:37:32.194ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c4847c37-6b31-4daf-8cf9-cf15be1000ae", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
44192024-11-27T18:37:32.194ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
44202024-11-27T18:37:32.194ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44212024-11-27T18:37:32.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8874356-4bcd-4891-9e63-b47687c3b8ab roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44222024-11-27T18:37:32.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8874356-4bcd-4891-9e63-b47687c3b8ab resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44232024-11-27T18:37:32.195ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a89b75-98ef-4273-9cc2-4e71be929912", "content-length": "682", "date": "Wed, 27 Nov 2024 18:37:32 GMT"} })
44242024-11-27T18:37:32.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44252024-11-27T18:37:32.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44262024-11-27T18:37:32.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8874356-4bcd-4891-9e63-b47687c3b8ab response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44272024-11-27T18:37:32.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44282024-11-27T18:37:32.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44292024-11-27T18:37:32.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44302024-11-27T18:37:32.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44312024-11-27T18:37:32.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44322024-11-27T18:37:32.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44332024-11-27T18:37:32.216ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.330703ms iteration = 7 status = {}
44342024-11-27T18:37:32.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 43b19100-af6f-462e-b576-c1fd13ad60d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
44352024-11-27T18:37:32.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 43b19100-af6f-462e-b576-c1fd13ad60d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
44362024-11-27T18:37:32.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 43b19100-af6f-462e-b576-c1fd13ad60d5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
44372024-11-27T18:37:33.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 971871b1-2a36-4fc2-ac99-a22d55a61d72 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44382024-11-27T18:37:33.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 971871b1-2a36-4fc2-ac99-a22d55a61d72 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44392024-11-27T18:37:33.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 971871b1-2a36-4fc2-ac99-a22d55a61d72 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44402024-11-27T18:37:33.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = c4ab4083-7387-44ab-91d1-edf1ad54ed9f response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
44412024-11-27T18:37:34.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56542222-7eeb-4ce6-9df7-9dfed5b031c7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44422024-11-27T18:37:34.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56542222-7eeb-4ce6-9df7-9dfed5b031c7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44432024-11-27T18:37:34.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56542222-7eeb-4ce6-9df7-9dfed5b031c7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44442024-11-27T18:37:35.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1320d6b0-8c23-4d6f-acb5-97b5221c9728 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44452024-11-27T18:37:35.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1320d6b0-8c23-4d6f-acb5-97b5221c9728 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44462024-11-27T18:37:35.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1320d6b0-8c23-4d6f-acb5-97b5221c9728 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44472024-11-27T18:37:36.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f7b51ff-f358-477e-b64f-377dd17a8623 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44482024-11-27T18:37:36.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f7b51ff-f358-477e-b64f-377dd17a8623 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44492024-11-27T18:37:36.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f7b51ff-f358-477e-b64f-377dd17a8623 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44502024-11-27T18:37:37.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4d61499a-a56e-4d17-a85f-9e54375fbf79 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44512024-11-27T18:37:37.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4d61499a-a56e-4d17-a85f-9e54375fbf79 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44522024-11-27T18:37:37.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4d61499a-a56e-4d17-a85f-9e54375fbf79 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44532024-11-27T18:37:38.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4acaac1f-9128-4776-8694-b6aff589bbd2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44542024-11-27T18:37:38.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4acaac1f-9128-4776-8694-b6aff589bbd2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44552024-11-27T18:37:38.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4acaac1f-9128-4776-8694-b6aff589bbd2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44562024-11-27T18:37:39.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6ca356af-b41a-410a-ad75-cb14140d3543 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44572024-11-27T18:37:39.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6ca356af-b41a-410a-ad75-cb14140d3543 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44582024-11-27T18:37:39.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6ca356af-b41a-410a-ad75-cb14140d3543 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44592024-11-27T18:37:40.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46f16419-ca10-4bc2-8fe0-055462463bb0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44602024-11-27T18:37:40.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46f16419-ca10-4bc2-8fe0-055462463bb0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44612024-11-27T18:37:40.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46f16419-ca10-4bc2-8fe0-055462463bb0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44622024-11-27T18:37:41.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
44632024-11-27T18:37:41.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44642024-11-27T18:37:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44652024-11-27T18:37:41.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
44662024-11-27T18:37:41.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44672024-11-27T18:37:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44682024-11-27T18:37:41.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44692024-11-27T18:37:41.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41c58a2f-6acc-455c-9d23-bfee250378be roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44702024-11-27T18:37:41.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41c58a2f-6acc-455c-9d23-bfee250378be resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44712024-11-27T18:37:41.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41c58a2f-6acc-455c-9d23-bfee250378be response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44722024-11-27T18:37:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44732024-11-27T18:37:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742024-11-27T18:37:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752024-11-27T18:37:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762024-11-27T18:37:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772024-11-27T18:37:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782024-11-27T18:37:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
44792024-11-27T18:37:41.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44802024-11-27T18:37:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44812024-11-27T18:37:41.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
44822024-11-27T18:37:41.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.773207ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
44832024-11-27T18:37:41.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44842024-11-27T18:37:41.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44852024-11-27T18:37:41.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.35176ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44862024-11-27T18:37:42.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 24be93de-387c-4ef1-aa2b-d13d762b6aed roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44872024-11-27T18:37:42.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 24be93de-387c-4ef1-aa2b-d13d762b6aed resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44882024-11-27T18:37:42.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 24be93de-387c-4ef1-aa2b-d13d762b6aed response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44892024-11-27T18:37:43.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3be495eb-0df7-4d23-b2e3-2ca206a784d1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44902024-11-27T18:37:43.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3be495eb-0df7-4d23-b2e3-2ca206a784d1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44912024-11-27T18:37:43.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3be495eb-0df7-4d23-b2e3-2ca206a784d1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
44922024-11-27T18:37:43.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6907e527-8581-498b-8d89-5000f6b91b54 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
44932024-11-27T18:37:43.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6907e527-8581-498b-8d89-5000f6b91b54 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
44942024-11-27T18:37:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 6907e527-8581-498b-8d89-5000f6b91b54 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
44952024-11-27T18:37:43.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 66e858f0-306c-4b97-b631-7994d4ba0918 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
44962024-11-27T18:37:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 66e858f0-306c-4b97-b631-7994d4ba0918 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
44972024-11-27T18:37:43.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 66e858f0-306c-4b97-b631-7994d4ba0918 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
44982024-11-27T18:37:43.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 496 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 23676f88-feea-45c5-aaa5-9b61529d20ff response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
44992024-11-27T18:37:44.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4787a72-c97d-4730-ae2c-7d8695b1fd47 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45002024-11-27T18:37:44.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4787a72-c97d-4730-ae2c-7d8695b1fd47 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45012024-11-27T18:37:44.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e4787a72-c97d-4730-ae2c-7d8695b1fd47 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45022024-11-27T18:37:45.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 841d4a6a-5b80-4296-8e9d-485dea1691ab roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45032024-11-27T18:37:45.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 841d4a6a-5b80-4296-8e9d-485dea1691ab resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45042024-11-27T18:37:45.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 841d4a6a-5b80-4296-8e9d-485dea1691ab response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45052024-11-27T18:37:46.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13afc294-a6c2-490a-b0d2-ad55b9a2663e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45062024-11-27T18:37:46.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13afc294-a6c2-490a-b0d2-ad55b9a2663e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45072024-11-27T18:37:46.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13afc294-a6c2-490a-b0d2-ad55b9a2663e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45082024-11-27T18:37:47.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aeac3a55-7dac-48b9-b338-58de1865e6d1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45092024-11-27T18:37:47.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aeac3a55-7dac-48b9-b338-58de1865e6d1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45102024-11-27T18:37:47.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = aeac3a55-7dac-48b9-b338-58de1865e6d1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45112024-11-27T18:37:48.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4041ef-7e0b-4a67-9dfe-0259de55fae8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45122024-11-27T18:37:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4041ef-7e0b-4a67-9dfe-0259de55fae8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45132024-11-27T18:37:48.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e4041ef-7e0b-4a67-9dfe-0259de55fae8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45142024-11-27T18:37:49.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 251ef6b7-63ea-47c6-93a5-6510b9b19094 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45152024-11-27T18:37:49.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 251ef6b7-63ea-47c6-93a5-6510b9b19094 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45162024-11-27T18:37:49.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 251ef6b7-63ea-47c6-93a5-6510b9b19094 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45172024-11-27T18:37:50.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 454e751f-0c23-4df3-8ba2-0941591238ba roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45182024-11-27T18:37:50.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 454e751f-0c23-4df3-8ba2-0941591238ba resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45192024-11-27T18:37:50.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 454e751f-0c23-4df3-8ba2-0941591238ba response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45202024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45212024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45222024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45232024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45242024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45252024-11-27T18:37:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45262024-11-27T18:37:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-11-27T18:37:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45282024-11-27T18:37:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45292024-11-27T18:37:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45302024-11-27T18:37:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45312024-11-27T18:37:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45322024-11-27T18:37:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-11-27T18:37:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
45342024-11-27T18:37:51.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-11-27T18:37:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362024-11-27T18:37:51.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
45372024-11-27T18:37:51.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.064157ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
45382024-11-27T18:37:51.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45392024-11-27T18:37:51.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45402024-11-27T18:37:51.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.913989ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45412024-11-27T18:37:51.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a871e61b-ee87-4a8f-ac2a-fe44126bb70e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45422024-11-27T18:37:51.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a871e61b-ee87-4a8f-ac2a-fe44126bb70e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45432024-11-27T18:37:51.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a871e61b-ee87-4a8f-ac2a-fe44126bb70e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45442024-11-27T18:37:52.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da182e08-6b31-4ce4-bb73-c0b8931badd9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45452024-11-27T18:37:52.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da182e08-6b31-4ce4-bb73-c0b8931badd9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45462024-11-27T18:37:52.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da182e08-6b31-4ce4-bb73-c0b8931badd9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45472024-11-27T18:37:53.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ea5858a0-f9a4-45c8-b113-f2442e2a2f6a response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
45482024-11-27T18:37:53.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f1feb2-d461-46c7-a9f0-6ed2dd2dc83c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45492024-11-27T18:37:53.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f1feb2-d461-46c7-a9f0-6ed2dd2dc83c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45502024-11-27T18:37:53.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73f1feb2-d461-46c7-a9f0-6ed2dd2dc83c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45512024-11-27T18:37:54.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 133eb51d-e8c6-442b-8920-551a35126b60 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45522024-11-27T18:37:54.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 133eb51d-e8c6-442b-8920-551a35126b60 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45532024-11-27T18:37:54.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 133eb51d-e8c6-442b-8920-551a35126b60 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45542024-11-27T18:37:55.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ed52ad-65c6-4ec3-ad17-f7efc069723c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45552024-11-27T18:37:55.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ed52ad-65c6-4ec3-ad17-f7efc069723c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45562024-11-27T18:37:55.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b4ed52ad-65c6-4ec3-ad17-f7efc069723c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45572024-11-27T18:37:56.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e94540bf-a7a1-4095-9daa-40c381703d8d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45582024-11-27T18:37:56.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e94540bf-a7a1-4095-9daa-40c381703d8d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45592024-11-27T18:37:56.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e94540bf-a7a1-4095-9daa-40c381703d8d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45602024-11-27T18:37:57.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aeec5a5-ee43-4f0c-a07f-221421b2fc30 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45612024-11-27T18:37:57.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aeec5a5-ee43-4f0c-a07f-221421b2fc30 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45622024-11-27T18:37:57.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aeec5a5-ee43-4f0c-a07f-221421b2fc30 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45632024-11-27T18:37:58.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = d2652445-36bb-42c1-88cc-9a7b8f22300a roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
45642024-11-27T18:37:58.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = d2652445-36bb-42c1-88cc-9a7b8f22300a resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
45652024-11-27T18:37:58.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = d2652445-36bb-42c1-88cc-9a7b8f22300a response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
45662024-11-27T18:37:58.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 7f9a474d-5780-4fc0-8471-518271bfb90f roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
45672024-11-27T18:37:58.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 7f9a474d-5780-4fc0-8471-518271bfb90f resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
45682024-11-27T18:37:58.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 7f9a474d-5780-4fc0-8471-518271bfb90f response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
45692024-11-27T18:37:58.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ea6d23a-a250-426c-b1a1-6322d82ec51b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45702024-11-27T18:37:58.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ea6d23a-a250-426c-b1a1-6322d82ec51b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45712024-11-27T18:37:58.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7ea6d23a-a250-426c-b1a1-6322d82ec51b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45722024-11-27T18:37:59.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1311db97-b497-4440-9226-cff9e5f1cd6d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45732024-11-27T18:37:59.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1311db97-b497-4440-9226-cff9e5f1cd6d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45742024-11-27T18:37:59.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1311db97-b497-4440-9226-cff9e5f1cd6d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45752024-11-27T18:38:00.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ffaff07b-949f-4b0b-a5c9-2d8e80f7b2fd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45762024-11-27T18:38:00.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ffaff07b-949f-4b0b-a5c9-2d8e80f7b2fd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45772024-11-27T18:38:00.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ffaff07b-949f-4b0b-a5c9-2d8e80f7b2fd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
45782024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
45792024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45802024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
45812024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
45822024-11-27T18:38:01.390ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45832024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45842024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45852024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
45862024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45872024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
45882024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
45892024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45902024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
45912024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45922024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
45932024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
45942024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45952024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
45962024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45972024-11-27T18:38:01.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45982024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
45992024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46002024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46012024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46022024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
46032024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46042024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46052024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46062024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46072024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46082024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46092024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46102024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46112024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46122024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46132024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46142024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46152024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46162024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46172024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46182024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46192024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46202024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
46212024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46222024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
46232024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46242024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46252024-11-27T18:38:01.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46262024-11-27T18:38:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46272024-11-27T18:38:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46282024-11-27T18:38:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46292024-11-27T18:38:01.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46302024-11-27T18:38:01.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312024-11-27T18:38:01.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.024395ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
46322024-11-27T18:38:01.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46342024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46352024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46362024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46372024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46382024-11-27T18:38:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46392024-11-27T18:38:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46402024-11-27T18:38:01.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46412024-11-27T18:38:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46422024-11-27T18:38:01.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 395859737 } })
46432024-11-27T18:38:01.398ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
46442024-11-27T18:38:01.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 399931277 } })
46452024-11-27T18:38:01.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
46462024-11-27T18:38:01.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46472024-11-27T18:38:01.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 403161715 } })
46482024-11-27T18:38:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46492024-11-27T18:38:01.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46502024-11-27T18:38:01.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
46512024-11-27T18:38:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46522024-11-27T18:38:01.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46532024-11-27T18:38:01.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46542024-11-27T18:38:01.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46562024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46572024-11-27T18:38:01.435ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46582024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46592024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46602024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46612024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.601712ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
46632024-11-27T18:38:01.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46642024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46652024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46662024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46672024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46682024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46692024-11-27T18:38:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46702024-11-27T18:38:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46712024-11-27T18:38:01.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46722024-11-27T18:38:01.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46732024-11-27T18:38:01.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46742024-11-27T18:38:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46752024-11-27T18:38:01.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
46762024-11-27T18:38:01.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46772024-11-27T18:38:01.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46782024-11-27T18:38:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46792024-11-27T18:38:01.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46802024-11-27T18:38:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46812024-11-27T18:38:01.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46822024-11-27T18:38:01.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46832024-11-27T18:38:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46842024-11-27T18:38:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46852024-11-27T18:38:01.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46862024-11-27T18:38:01.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.794777ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46872024-11-27T18:38:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46882024-11-27T18:38:01.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.096692ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46892024-11-27T18:38:01.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46902024-11-27T18:38:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46912024-11-27T18:38:01.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-27T18:38:01.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46932024-11-27T18:38:01.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46942024-11-27T18:38:01.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46952024-11-27T18:38:01.455ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46962024-11-27T18:38:01.455ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.502972ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46972024-11-27T18:38:01.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
46982024-11-27T18:38:01.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.558207ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
46992024-11-27T18:38:01.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.760321ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47002024-11-27T18:38:01.486ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47012024-11-27T18:38:01.486ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47022024-11-27T18:38:01.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47032024-11-27T18:38:01.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47042024-11-27T18:38:01.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47052024-11-27T18:38:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47062024-11-27T18:38:01.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47072024-11-27T18:38:01.491ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47082024-11-27T18:38:01.492ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef39ce8-ac9a-44d2-87e4-304c602ff910", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47092024-11-27T18:38:01.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47102024-11-27T18:38:01.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47112024-11-27T18:38:01.502ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 111.348441ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47122024-11-27T18:38:01.505ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47132024-11-27T18:38:01.505ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47142024-11-27T18:38:01.505ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15360183-4847-4833-aefd-cd838c781e08", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47152024-11-27T18:38:01.505ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47162024-11-27T18:38:01.507ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47172024-11-27T18:38:01.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
47182024-11-27T18:38:01.514ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47192024-11-27T18:38:01.514ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f110df5-d61a-4366-98b6-81836b0fc1d5", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47202024-11-27T18:38:01.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47212024-11-27T18:38:01.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
47222024-11-27T18:38:01.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.995681ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47232024-11-27T18:38:01.525ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47242024-11-27T18:38:01.525ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47252024-11-27T18:38:01.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.146099ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47262024-11-27T18:38:01.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47272024-11-27T18:38:01.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47282024-11-27T18:38:01.560ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.782796ms iteration = 10 status = {"physical_disks_added":0}
47292024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47302024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47312024-11-27T18:38:01.615ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47322024-11-27T18:38:01.615ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e7fdd74-e9d4-4aa6-8763-003965af41ec", "content-length": "1", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
47332024-11-27T18:38:01.617ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47342024-11-27T18:38:01.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47352024-11-27T18:38:01.701ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.256579ms iteration = 8 status = {}
47362024-11-27T18:38:01.705ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47372024-11-27T18:38:01.705ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47382024-11-27T18:38:01.705ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3d45864-2a83-4fb5-8b38-945da4d2b3f2", "content-length": "372", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47392024-11-27T18:38:01.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47402024-11-27T18:38:01.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47412024-11-27T18:38:01.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422024-11-27T18:38:01.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47432024-11-27T18:38:01.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47442024-11-27T18:38:01.709ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 317.110991ms iteration = 8 status = null
47452024-11-27T18:38:01.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47462024-11-27T18:38:01.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47472024-11-27T18:38:01.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47482024-11-27T18:38:01.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492024-11-27T18:38:01.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47502024-11-27T18:38:01.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47512024-11-27T18:38:01.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47522024-11-27T18:38:01.726ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
47532024-11-27T18:38:01.726ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47542024-11-27T18:38:01.726ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "043af18b-5ce1-4b69-b7e4-aeea6d4ffa51", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47552024-11-27T18:38:01.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47562024-11-27T18:38:01.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47572024-11-27T18:38:01.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47582024-11-27T18:38:01.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47592024-11-27T18:38:01.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47602024-11-27T18:38:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47612024-11-27T18:38:01.736ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47622024-11-27T18:38:01.736ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47632024-11-27T18:38:01.736ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ea9ab485-5e11-482a-a476-dd30e3c64d4a", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47642024-11-27T18:38:01.738ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.632523ms iteration = 8 status = {}
47652024-11-27T18:38:01.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47662024-11-27T18:38:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
47672024-11-27T18:38:01.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47682024-11-27T18:38:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47692024-11-27T18:38:01.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47702024-11-27T18:38:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47712024-11-27T18:38:01.746ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 355.918646ms iteration = 8 status = 0
47722024-11-27T18:38:01.753ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
47732024-11-27T18:38:01.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47742024-11-27T18:38:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47752024-11-27T18:38:01.764ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47762024-11-27T18:38:01.764ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8eb7dd1-4846-47c1-9eaf-ae8a7194e3b9", "content-length": "134", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
47772024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47782024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
47792024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47802024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47812024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47822024-11-27T18:38:01.764ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47832024-11-27T18:38:01.765ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47842024-11-27T18:38:01.765ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47852024-11-27T18:38:01.765ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47862024-11-27T18:38:01.765ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47872024-11-27T18:38:01.765ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
47882024-11-27T18:38:01.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47892024-11-27T18:38:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47902024-11-27T18:38:01.767ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47912024-11-27T18:38:01.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e29932d7-8069-428a-b68b-e36a71d1180d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
47922024-11-27T18:38:01.768ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47932024-11-27T18:38:01.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d83b5b5e-f37f-4df8-aabc-8962663e492c", "content-length": "52", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
47942024-11-27T18:38:01.768ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
47952024-11-27T18:38:01.768ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47962024-11-27T18:38:01.818ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47972024-11-27T18:38:01.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cb5addfe-0b5f-4275-9f67-b2a1bb53f676", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
47982024-11-27T18:38:01.862ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
47992024-11-27T18:38:01.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48002024-11-27T18:38:01.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 826c992e-91ac-4e6f-af6c-7f1e1e1bfb65 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48012024-11-27T18:38:01.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 826c992e-91ac-4e6f-af6c-7f1e1e1bfb65 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48022024-11-27T18:38:01.863ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0979614e-001c-4d9f-8ec6-f4a7d768f9aa", "content-length": "682", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
48032024-11-27T18:38:01.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48042024-11-27T18:38:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48052024-11-27T18:38:01.864ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfa5107c-d8d7-4a82-8950-f135b7520a9f", "content-length": "691", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
48062024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48072024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48082024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48092024-11-27T18:38:01.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 826c992e-91ac-4e6f-af6c-7f1e1e1bfb65 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48102024-11-27T18:38:01.866ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.424506ms iteration = 8 status = {}
48112024-11-27T18:38:01.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48122024-11-27T18:38:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48132024-11-27T18:38:01.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48142024-11-27T18:38:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48152024-11-27T18:38:01.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48162024-11-27T18:38:01.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48172024-11-27T18:38:01.880ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.745949ms iteration = 8 status = {}
48182024-11-27T18:38:01.912ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48192024-11-27T18:38:01.913ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
48202024-11-27T18:38:01.944ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
48212024-11-27T18:38:01.944ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:51296
48222024-11-27T18:38:01.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51296 req_id = acb76877-0b4a-4710-a8b7-8ee3f0f0f4f1 roles = RoleSet { roles: {} } uri = /metrics/producers
48232024-11-27T18:38:01.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51296 req_id = acb76877-0b4a-4710-a8b7-8ee3f0f0f4f1 resource = Database result = Ok(()) uri = /metrics/producers
48242024-11-27T18:38:01.978ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 236c7b74-8315-46e3-9a37-90380a675558
48252024-11-27T18:38:01.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34038 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51296 req_id = acb76877-0b4a-4710-a8b7-8ee3f0f0f4f1 response_code = 201 uri = /metrics/producers
48262024-11-27T18:38:01.978ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "acb76877-0b4a-4710-a8b7-8ee3f0f0f4f1", "content-length": "41", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
48272024-11-27T18:38:01.981ZDEBGnexus (producer-registration-task): registered with nexus successfully
48282024-11-27T18:38:01.981ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48292024-11-27T18:38:02.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 6f114071-8d90-4589-8231-4b2e64de9ca6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
48302024-11-27T18:38:02.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 6f114071-8d90-4589-8231-4b2e64de9ca6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
48312024-11-27T18:38:02.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 6f114071-8d90-4589-8231-4b2e64de9ca6 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
48322024-11-27T18:38:02.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c8b99fe-6f1e-4035-953f-77aa78a6166b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48332024-11-27T18:38:02.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c8b99fe-6f1e-4035-953f-77aa78a6166b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48342024-11-27T18:38:02.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c8b99fe-6f1e-4035-953f-77aa78a6166b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48352024-11-27T18:38:03.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 556 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = cde7c870-e9c9-44d6-a67c-73f86f1a3bd5 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
48362024-11-27T18:38:03.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a6b6ed6-4003-484b-a505-7c7cd9128582 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48372024-11-27T18:38:03.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a6b6ed6-4003-484b-a505-7c7cd9128582 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48382024-11-27T18:38:03.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a6b6ed6-4003-484b-a505-7c7cd9128582 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48392024-11-27T18:38:04.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf15bfc-1bef-4fe1-aa12-275bdeb7dfa9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48402024-11-27T18:38:04.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf15bfc-1bef-4fe1-aa12-275bdeb7dfa9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48412024-11-27T18:38:04.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf15bfc-1bef-4fe1-aa12-275bdeb7dfa9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48422024-11-27T18:38:05.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e207331-1c80-4e2a-b2bc-d1893c3bd0e2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48432024-11-27T18:38:05.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e207331-1c80-4e2a-b2bc-d1893c3bd0e2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48442024-11-27T18:38:05.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e207331-1c80-4e2a-b2bc-d1893c3bd0e2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48452024-11-27T18:38:06.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a709053-883b-4d2a-ae92-3b191f10055b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48462024-11-27T18:38:06.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a709053-883b-4d2a-ae92-3b191f10055b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48472024-11-27T18:38:06.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a709053-883b-4d2a-ae92-3b191f10055b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48482024-11-27T18:38:07.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ea93c8f-7334-4671-8d75-813602041886 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48492024-11-27T18:38:07.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ea93c8f-7334-4671-8d75-813602041886 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48502024-11-27T18:38:07.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0ea93c8f-7334-4671-8d75-813602041886 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48512024-11-27T18:38:09.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5fed0914-5890-4ee0-b11e-6d5be5423613 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48522024-11-27T18:38:09.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5fed0914-5890-4ee0-b11e-6d5be5423613 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48532024-11-27T18:38:09.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5fed0914-5890-4ee0-b11e-6d5be5423613 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48542024-11-27T18:38:10.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 940436cc-19fc-499f-b90d-569c0a98900d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48552024-11-27T18:38:10.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 940436cc-19fc-499f-b90d-569c0a98900d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48562024-11-27T18:38:10.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 940436cc-19fc-499f-b90d-569c0a98900d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48572024-11-27T18:38:11.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = caba1bf0-1c08-40fd-b614-7d7f0ecea3d6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48582024-11-27T18:38:11.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = caba1bf0-1c08-40fd-b614-7d7f0ecea3d6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48592024-11-27T18:38:11.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = caba1bf0-1c08-40fd-b614-7d7f0ecea3d6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48602024-11-27T18:38:11.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
48612024-11-27T18:38:11.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48622024-11-27T18:38:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48632024-11-27T18:38:11.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
48642024-11-27T18:38:11.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48652024-11-27T18:38:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48662024-11-27T18:38:11.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48672024-11-27T18:38:11.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48682024-11-27T18:38:11.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692024-11-27T18:38:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48702024-11-27T18:38:11.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48712024-11-27T18:38:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48722024-11-27T18:38:11.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48732024-11-27T18:38:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48742024-11-27T18:38:11.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752024-11-27T18:38:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
48762024-11-27T18:38:11.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48772024-11-27T18:38:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48782024-11-27T18:38:11.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
48792024-11-27T18:38:11.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.152637ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
48802024-11-27T18:38:11.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.601118ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48812024-11-27T18:38:12.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61afd7a9-5d49-4b54-bd87-a2acf2d93d7d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48822024-11-27T18:38:12.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61afd7a9-5d49-4b54-bd87-a2acf2d93d7d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48832024-11-27T18:38:12.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61afd7a9-5d49-4b54-bd87-a2acf2d93d7d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48842024-11-27T18:38:13.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7f36ed-b5c7-4aab-831f-5fe82a214966 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48852024-11-27T18:38:13.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7f36ed-b5c7-4aab-831f-5fe82a214966 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48862024-11-27T18:38:13.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7f36ed-b5c7-4aab-831f-5fe82a214966 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48872024-11-27T18:38:13.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = fdd099ba-92b4-4a18-9ed9-815d69cfb379 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
48882024-11-27T18:38:13.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = fdd099ba-92b4-4a18-9ed9-815d69cfb379 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
48892024-11-27T18:38:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = fdd099ba-92b4-4a18-9ed9-815d69cfb379 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
48902024-11-27T18:38:13.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3519ee0e-fe53-4454-b515-8df7635cfe73 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
48912024-11-27T18:38:13.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3519ee0e-fe53-4454-b515-8df7635cfe73 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
48922024-11-27T18:38:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 3519ee0e-fe53-4454-b515-8df7635cfe73 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
48932024-11-27T18:38:13.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 66a97d0a-facc-46b2-ad29-481d480733ce response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
48942024-11-27T18:38:14.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb18aab6-e9c1-43b3-82ca-b74d9acbbd31 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48952024-11-27T18:38:14.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb18aab6-e9c1-43b3-82ca-b74d9acbbd31 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48962024-11-27T18:38:14.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb18aab6-e9c1-43b3-82ca-b74d9acbbd31 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48972024-11-27T18:38:15.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 68cc9cec-9ac8-4ddd-8a27-a8b68156875c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48982024-11-27T18:38:15.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 68cc9cec-9ac8-4ddd-8a27-a8b68156875c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
48992024-11-27T18:38:15.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 68cc9cec-9ac8-4ddd-8a27-a8b68156875c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49002024-11-27T18:38:16.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8478412-4f9a-416f-8e5e-e7b99c64139c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49012024-11-27T18:38:16.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8478412-4f9a-416f-8e5e-e7b99c64139c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49022024-11-27T18:38:16.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a8478412-4f9a-416f-8e5e-e7b99c64139c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49032024-11-27T18:38:17.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c43c0c73-ce77-4f27-a993-967a35c77af1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49042024-11-27T18:38:17.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c43c0c73-ce77-4f27-a993-967a35c77af1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49052024-11-27T18:38:17.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c43c0c73-ce77-4f27-a993-967a35c77af1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49062024-11-27T18:38:18.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b606deda-eaf4-4773-80e5-277043229258 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49072024-11-27T18:38:18.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b606deda-eaf4-4773-80e5-277043229258 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49082024-11-27T18:38:18.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b606deda-eaf4-4773-80e5-277043229258 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49092024-11-27T18:38:19.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91cbe7e9-bc71-4de1-9b42-9cc2d376f8c3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49102024-11-27T18:38:19.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91cbe7e9-bc71-4de1-9b42-9cc2d376f8c3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49112024-11-27T18:38:19.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91cbe7e9-bc71-4de1-9b42-9cc2d376f8c3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49122024-11-27T18:38:20.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5afa38b5-a2d6-4bb3-955f-30c7e4d63554 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49132024-11-27T18:38:20.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5afa38b5-a2d6-4bb3-955f-30c7e4d63554 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49142024-11-27T18:38:20.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5afa38b5-a2d6-4bb3-955f-30c7e4d63554 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49152024-11-27T18:38:21.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bacac0ad-21ff-47af-bd18-8b18a0833301 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49162024-11-27T18:38:21.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bacac0ad-21ff-47af-bd18-8b18a0833301 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49172024-11-27T18:38:21.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bacac0ad-21ff-47af-bd18-8b18a0833301 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49182024-11-27T18:38:21.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49192024-11-27T18:38:21.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49202024-11-27T18:38:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49212024-11-27T18:38:21.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49222024-11-27T18:38:21.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49232024-11-27T18:38:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49242024-11-27T18:38:21.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49252024-11-27T18:38:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49262024-11-27T18:38:21.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49272024-11-27T18:38:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49282024-11-27T18:38:21.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49292024-11-27T18:38:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49302024-11-27T18:38:21.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.021009ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49312024-11-27T18:38:21.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-11-27T18:38:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49332024-11-27T18:38:21.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-11-27T18:38:21.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
49352024-11-27T18:38:21.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49362024-11-27T18:38:21.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49372024-11-27T18:38:21.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
49382024-11-27T18:38:21.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.432657ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
49392024-11-27T18:38:22.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 506df4dc-4414-4590-a483-ce67dfe16a26 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49402024-11-27T18:38:22.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 506df4dc-4414-4590-a483-ce67dfe16a26 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49412024-11-27T18:38:22.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 506df4dc-4414-4590-a483-ce67dfe16a26 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49422024-11-27T18:38:23.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07658eda-3e8e-45ec-91b8-5355378d7b66 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49432024-11-27T18:38:23.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07658eda-3e8e-45ec-91b8-5355378d7b66 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49442024-11-27T18:38:23.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07658eda-3e8e-45ec-91b8-5355378d7b66 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49452024-11-27T18:38:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a31fdc20-e76f-4e80-8206-1ca117d2eab2 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
49462024-11-27T18:38:24.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2055d953-1513-4e85-a6f7-ed3fbc1f11f8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49472024-11-27T18:38:24.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2055d953-1513-4e85-a6f7-ed3fbc1f11f8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49482024-11-27T18:38:24.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2055d953-1513-4e85-a6f7-ed3fbc1f11f8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49492024-11-27T18:38:25.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db8898ed-c356-4222-af7d-06199f1f5ad7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49502024-11-27T18:38:25.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db8898ed-c356-4222-af7d-06199f1f5ad7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49512024-11-27T18:38:25.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = db8898ed-c356-4222-af7d-06199f1f5ad7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49522024-11-27T18:38:26.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aec64ab-b7ce-4d70-a01c-840c19b2ef7d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49532024-11-27T18:38:26.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aec64ab-b7ce-4d70-a01c-840c19b2ef7d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49542024-11-27T18:38:26.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7aec64ab-b7ce-4d70-a01c-840c19b2ef7d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49552024-11-27T18:38:27.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95dbfd37-1d30-4876-bc08-38b621c3f875 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49562024-11-27T18:38:27.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95dbfd37-1d30-4876-bc08-38b621c3f875 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49572024-11-27T18:38:27.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 95dbfd37-1d30-4876-bc08-38b621c3f875 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49582024-11-27T18:38:28.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e47c567-3ddb-49f5-bda2-de70ab8e21c3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49592024-11-27T18:38:28.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e47c567-3ddb-49f5-bda2-de70ab8e21c3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49602024-11-27T18:38:28.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e47c567-3ddb-49f5-bda2-de70ab8e21c3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49612024-11-27T18:38:28.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 330d1507-d400-45fd-972f-3d08b68b91a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49622024-11-27T18:38:28.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 330d1507-d400-45fd-972f-3d08b68b91a5 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49632024-11-27T18:38:28.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 330d1507-d400-45fd-972f-3d08b68b91a5 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49642024-11-27T18:38:28.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = eacc5a17-fa63-41ee-8ad8-2471b45df373 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49652024-11-27T18:38:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = eacc5a17-fa63-41ee-8ad8-2471b45df373 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49662024-11-27T18:38:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = eacc5a17-fa63-41ee-8ad8-2471b45df373 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49672024-11-27T18:38:29.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6a8fb31-c0fe-4229-b4f1-3e0c4fb1025c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49682024-11-27T18:38:29.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6a8fb31-c0fe-4229-b4f1-3e0c4fb1025c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49692024-11-27T18:38:29.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c6a8fb31-c0fe-4229-b4f1-3e0c4fb1025c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49702024-11-27T18:38:30.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1768e9af-14b5-4a8e-b83d-5adeef94d3c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49712024-11-27T18:38:30.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1768e9af-14b5-4a8e-b83d-5adeef94d3c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49722024-11-27T18:38:30.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1768e9af-14b5-4a8e-b83d-5adeef94d3c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
49732024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
49742024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
49752024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49762024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
49772024-11-27T18:38:31.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49782024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49792024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
49802024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
49812024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49822024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49832024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49842024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
49852024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
49862024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
49872024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49882024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49892024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
49902024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
49912024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
49922024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49932024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49942024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
49952024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49962024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
49972024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
49982024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50002024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50012024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50022024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50032024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50042024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50052024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
50062024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
50072024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50082024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
50092024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
50102024-11-27T18:38:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
50112024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50122024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
50132024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.851\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
50142024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50152024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
50162024-11-27T18:38:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50172024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
50182024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50192024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50202024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
50212024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50222024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50232024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50242024-11-27T18:38:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:28:31.391548841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50252024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50262024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
50272024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50282024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
50292024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50302024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50312024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50322024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50332024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50342024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
50352024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50362024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50372024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50382024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50392024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50402024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50412024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50422024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50432024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50442024-11-27T18:38:31.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50452024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50462024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50472024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50482024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50492024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50502024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50512024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50522024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50532024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50542024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50552024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50562024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50572024-11-27T18:38:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 389731226 } })
50582024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50592024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50602024-11-27T18:38:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 389871758 } })
50612024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50622024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.310979ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50632024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50642024-11-27T18:38:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.131977ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50652024-11-27T18:38:31.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50662024-11-27T18:38:31.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672024-11-27T18:38:31.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50682024-11-27T18:38:31.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50692024-11-27T18:38:31.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50702024-11-27T18:38:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50712024-11-27T18:38:31.397ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.960929ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
50722024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50732024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50742024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50752024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50762024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50772024-11-27T18:38:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50782024-11-27T18:38:31.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50792024-11-27T18:38:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50802024-11-27T18:38:31.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50812024-11-27T18:38:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50822024-11-27T18:38:31.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 399511641 } })
50832024-11-27T18:38:31.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50842024-11-27T18:38:31.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50852024-11-27T18:38:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50862024-11-27T18:38:31.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50872024-11-27T18:38:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50882024-11-27T18:38:31.408ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:28:31.391548841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50892024-11-27T18:38:31.408ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.485695ms iteration = 5 status = {"expiration":"2024-11-27T18:28:31.391548841Z","pruned":[]}
50902024-11-27T18:38:31.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50912024-11-27T18:38:31.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50922024-11-27T18:38:31.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50932024-11-27T18:38:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50942024-11-27T18:38:31.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50952024-11-27T18:38:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50962024-11-27T18:38:31.420ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 417838602 } })
50972024-11-27T18:38:31.420ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
50982024-11-27T18:38:31.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50992024-11-27T18:38:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51002024-11-27T18:38:31.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.72415ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51012024-11-27T18:38:31.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51022024-11-27T18:38:31.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51032024-11-27T18:38:31.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 431617957 } })
51042024-11-27T18:38:31.434ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
51052024-11-27T18:38:31.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062024-11-27T18:38:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
51072024-11-27T18:38:31.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51082024-11-27T18:38:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51092024-11-27T18:38:31.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51102024-11-27T18:38:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51112024-11-27T18:38:31.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51122024-11-27T18:38:31.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51132024-11-27T18:38:31.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.704687ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
51142024-11-27T18:38:31.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.015876ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51152024-11-27T18:38:31.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51162024-11-27T18:38:31.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51172024-11-27T18:38:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51182024-11-27T18:38:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51192024-11-27T18:38:31.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51202024-11-27T18:38:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51212024-11-27T18:38:31.455ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51222024-11-27T18:38:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51232024-11-27T18:38:31.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.775795ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51242024-11-27T18:38:31.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51252024-11-27T18:38:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51262024-11-27T18:38:31.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272024-11-27T18:38:31.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51292024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51302024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51312024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51322024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51332024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51342024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51352024-11-27T18:38:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51362024-11-27T18:38:31.470ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51372024-11-27T18:38:31.470ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51382024-11-27T18:38:31.470ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.040931ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51392024-11-27T18:38:31.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51402024-11-27T18:38:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51412024-11-27T18:38:31.472ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422024-11-27T18:38:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51432024-11-27T18:38:31.474ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51442024-11-27T18:38:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51452024-11-27T18:38:31.475ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51462024-11-27T18:38:31.475ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51472024-11-27T18:38:31.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51482024-11-27T18:38:31.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51492024-11-27T18:38:31.477ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51502024-11-27T18:38:31.477ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
51512024-11-27T18:38:31.477ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.728316ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
51522024-11-27T18:38:31.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51532024-11-27T18:38:31.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51542024-11-27T18:38:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51552024-11-27T18:38:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 101.121669ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51562024-11-27T18:38:31.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f20a3b2-91fc-4cf6-9700-868d422bb717 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
51572024-11-27T18:38:31.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f20a3b2-91fc-4cf6-9700-868d422bb717 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
51582024-11-27T18:38:31.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f20a3b2-91fc-4cf6-9700-868d422bb717 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
51592024-11-27T18:38:31.496ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.065637ms iteration = 11 status = {"physical_disks_added":0}
51602024-11-27T18:38:31.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51612024-11-27T18:38:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51622024-11-27T18:38:31.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51632024-11-27T18:38:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51642024-11-27T18:38:31.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51652024-11-27T18:38:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51662024-11-27T18:38:31.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51672024-11-27T18:38:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
51682024-11-27T18:38:31.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51692024-11-27T18:38:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51702024-11-27T18:38:31.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.043715ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51712024-11-27T18:38:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.572488ms iteration = 9 status = 0
51722024-11-27T18:38:31.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51732024-11-27T18:38:31.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51742024-11-27T18:38:31.511ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51752024-11-27T18:38:31.511ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.904157ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51762024-11-27T18:38:31.512ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51772024-11-27T18:38:31.512ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
51782024-11-27T18:38:31.512ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
51792024-11-27T18:38:31.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51802024-11-27T18:38:31.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51812024-11-27T18:38:31.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51822024-11-27T18:38:31.517ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51832024-11-27T18:38:31.517ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51842024-11-27T18:38:31.517ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.526271ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51852024-11-27T18:38:31.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51862024-11-27T18:38:31.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51872024-11-27T18:38:31.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51882024-11-27T18:38:31.519ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51892024-11-27T18:38:31.519ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51902024-11-27T18:38:31.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51912024-11-27T18:38:31.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51922024-11-27T18:38:31.520ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51932024-11-27T18:38:31.520ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51942024-11-27T18:38:31.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51952024-11-27T18:38:31.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51962024-11-27T18:38:31.521ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51992024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52002024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52012024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52022024-11-27T18:38:31.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52032024-11-27T18:38:31.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52042024-11-27T18:38:31.524ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52052024-11-27T18:38:31.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52062024-11-27T18:38:31.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52072024-11-27T18:38:31.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52082024-11-27T18:38:31.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52092024-11-27T18:38:31.529ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52102024-11-27T18:38:31.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52112024-11-27T18:38:31.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52122024-11-27T18:38:31.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.03554ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52132024-11-27T18:38:31.561ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52142024-11-27T18:38:31.561ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52152024-11-27T18:38:31.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.833588ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52162024-11-27T18:38:31.592ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
52172024-11-27T18:38:31.592ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52182024-11-27T18:38:31.593ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e71def0c-02ed-4021-97c9-dda6777a62e8", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
52192024-11-27T18:38:31.593ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52202024-11-27T18:38:31.595ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
52212024-11-27T18:38:31.607ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52222024-11-27T18:38:31.607ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 215.665637ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52232024-11-27T18:38:31.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52242024-11-27T18:38:31.622ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52252024-11-27T18:38:31.622ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75a2bc3-0d59-4c2b-9400-b3bcae251b86", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
52262024-11-27T18:38:31.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52272024-11-27T18:38:31.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52282024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52292024-11-27T18:38:31.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52302024-11-27T18:38:31.717ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52312024-11-27T18:38:31.718ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d411c387-62a5-4974-b14c-1439dbddd7f0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
52322024-11-27T18:38:31.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52332024-11-27T18:38:31.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52342024-11-27T18:38:31.720ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52352024-11-27T18:38:31.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fd60ed96-df8e-4476-a6b5-66a380cd7220", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52362024-11-27T18:38:31.720ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52372024-11-27T18:38:31.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3e54c439-d8bc-4699-a6b4-839546ecbbcf", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52382024-11-27T18:38:31.722ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52392024-11-27T18:38:31.723ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52402024-11-27T18:38:31.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.541769ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52412024-11-27T18:38:31.742ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52422024-11-27T18:38:31.742ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52432024-11-27T18:38:31.743ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "607730bd-8443-424f-8dc0-40572435d748", "content-length": "372", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
52442024-11-27T18:38:31.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52452024-11-27T18:38:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52462024-11-27T18:38:31.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52472024-11-27T18:38:31.746ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52482024-11-27T18:38:31.746ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52492024-11-27T18:38:31.746ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
52502024-11-27T18:38:31.746ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 354.86293ms iteration = 5 status = {"generation":1}
52512024-11-27T18:38:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52522024-11-27T18:38:31.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52532024-11-27T18:38:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52542024-11-27T18:38:31.753ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52552024-11-27T18:38:31.753ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a3bd75-2649-4d3d-bc8d-1f7062f28d7f", "content-length": "1", "date": "Wed, 27 Nov 2024 18:38:30 GMT"} })
52562024-11-27T18:38:31.755ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52572024-11-27T18:38:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52582024-11-27T18:38:31.757ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.645539ms iteration = 9 status = null
52592024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52602024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
52612024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52622024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52632024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52642024-11-27T18:38:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52652024-11-27T18:38:31.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52662024-11-27T18:38:31.785ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-11-27T18:38:31.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52682024-11-27T18:38:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52692024-11-27T18:38:31.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52702024-11-27T18:38:31.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52712024-11-27T18:38:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52722024-11-27T18:38:31.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-11-27T18:38:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52742024-11-27T18:38:31.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52752024-11-27T18:38:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52762024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52772024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52782024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52792024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
52802024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52812024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
52822024-11-27T18:38:31.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 399.098726ms iteration = 5 status = {"generation":2}
52832024-11-27T18:38:31.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52842024-11-27T18:38:31.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52852024-11-27T18:38:31.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52862024-11-27T18:38:31.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52872024-11-27T18:38:31.799ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
52882024-11-27T18:38:31.799ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52892024-11-27T18:38:31.799ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8b38ce49-7cc2-4677-a647-1495518b1c7c", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
52902024-11-27T18:38:31.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52912024-11-27T18:38:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52922024-11-27T18:38:31.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52932024-11-27T18:38:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52942024-11-27T18:38:31.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52952024-11-27T18:38:31.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52962024-11-27T18:38:31.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52972024-11-27T18:38:31.812ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52982024-11-27T18:38:31.812ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52992024-11-27T18:38:31.813ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a0ca9305-744a-4cf7-8ea4-03e7051fd294", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53002024-11-27T18:38:31.814ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.484756ms iteration = 9 status = {}
53012024-11-27T18:38:31.825ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
53022024-11-27T18:38:31.825ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 434.398988ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53032024-11-27T18:38:31.885ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 493.944661ms iteration = 9 status = {}
53042024-11-27T18:38:31.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53052024-11-27T18:38:31.910ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "23752ff1-164e-4c81-b451-968056545bd0", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53062024-11-27T18:38:31.910ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53072024-11-27T18:38:31.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b038988f-ca47-4d25-8727-2de403002b21", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53082024-11-27T18:38:31.911ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53092024-11-27T18:38:31.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f112b002-a140-4a4c-a8d7-41abf3f2870a", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53102024-11-27T18:38:31.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53112024-11-27T18:38:31.915ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53122024-11-27T18:38:31.915ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 524.598645ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53132024-11-27T18:38:31.930ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53142024-11-27T18:38:31.930ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aa872d1-130c-427f-b061-dd2be039d718", "content-length": "691", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53152024-11-27T18:38:31.931ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53162024-11-27T18:38:31.931ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53172024-11-27T18:38:31.931ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53182024-11-27T18:38:31.932ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 540.934928ms iteration = 9 status = {}
53192024-11-27T18:38:31.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53202024-11-27T18:38:31.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53212024-11-27T18:38:31.945ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
53222024-11-27T18:38:31.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53232024-11-27T18:38:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53242024-11-27T18:38:31.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53252024-11-27T18:38:31.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1ba3d5-c5b0-4008-a58a-9098208766da", "content-length": "134", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53262024-11-27T18:38:31.952ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53272024-11-27T18:38:31.952ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
53282024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53292024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53302024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53312024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53322024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53332024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53342024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53352024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53362024-11-27T18:38:31.953ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
53372024-11-27T18:38:31.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53382024-11-27T18:38:31.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53392024-11-27T18:38:31.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53402024-11-27T18:38:31.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8881f776-c20a-42a7-9269-a2b36e942916", "content-length": "2", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53412024-11-27T18:38:31.956ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53422024-11-27T18:38:31.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8aac68-3fb6-47df-92b1-5d674be557f9", "content-length": "52", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53432024-11-27T18:38:31.956ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
53442024-11-27T18:38:31.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53452024-11-27T18:38:32.087ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "21e78e44-4bbe-4094-b5d2-bb2dfa0c4aca", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53462024-11-27T18:38:32.087ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
53472024-11-27T18:38:32.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53482024-11-27T18:38:32.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d45c440-2d8c-4b9b-948a-41489d074ced", "content-length": "682", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
53492024-11-27T18:38:32.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53502024-11-27T18:38:32.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53512024-11-27T18:38:32.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53522024-11-27T18:38:32.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53532024-11-27T18:38:32.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53542024-11-27T18:38:32.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53552024-11-27T18:38:32.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53562024-11-27T18:38:32.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53572024-11-27T18:38:32.214ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 823.352504ms iteration = 9 status = {}
53582024-11-27T18:38:32.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c0267996-984a-42c8-97be-c904e58a48c6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
53592024-11-27T18:38:32.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c0267996-984a-42c8-97be-c904e58a48c6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
53602024-11-27T18:38:32.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = c0267996-984a-42c8-97be-c904e58a48c6 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
53612024-11-27T18:38:32.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d954976c-015a-4701-9686-fb0e850da840 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53622024-11-27T18:38:32.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d954976c-015a-4701-9686-fb0e850da840 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53632024-11-27T18:38:32.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d954976c-015a-4701-9686-fb0e850da840 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53642024-11-27T18:38:33.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34e91cdc-1b85-4a7a-aaea-56e7dc2c2359 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53652024-11-27T18:38:33.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34e91cdc-1b85-4a7a-aaea-56e7dc2c2359 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53662024-11-27T18:38:33.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34e91cdc-1b85-4a7a-aaea-56e7dc2c2359 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53672024-11-27T18:38:33.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 25801430-e196-44c4-b7d4-7d1be0c7d3df response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
53682024-11-27T18:38:34.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55a5081d-0b3e-4723-a11f-09afed42e785 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53692024-11-27T18:38:34.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55a5081d-0b3e-4723-a11f-09afed42e785 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53702024-11-27T18:38:34.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 55a5081d-0b3e-4723-a11f-09afed42e785 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53712024-11-27T18:38:35.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34561903-9c32-4c67-b567-3dc5b879f5e6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53722024-11-27T18:38:35.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34561903-9c32-4c67-b567-3dc5b879f5e6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53732024-11-27T18:38:35.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34561903-9c32-4c67-b567-3dc5b879f5e6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53742024-11-27T18:38:36.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5d11020-8725-4cfc-86b9-ec2da5de23bf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53752024-11-27T18:38:36.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5d11020-8725-4cfc-86b9-ec2da5de23bf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53762024-11-27T18:38:36.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5d11020-8725-4cfc-86b9-ec2da5de23bf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53772024-11-27T18:38:37.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e41b1a-aaf5-4498-bb81-2096c7f5310b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53782024-11-27T18:38:37.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e41b1a-aaf5-4498-bb81-2096c7f5310b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53792024-11-27T18:38:37.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e41b1a-aaf5-4498-bb81-2096c7f5310b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53802024-11-27T18:38:38.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9a7feab-ad40-4005-87b4-cb478b804a75 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53812024-11-27T18:38:38.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9a7feab-ad40-4005-87b4-cb478b804a75 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53822024-11-27T18:38:38.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9a7feab-ad40-4005-87b4-cb478b804a75 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53832024-11-27T18:38:39.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7609a1c1-676f-4fa2-81f1-2292231523dd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53842024-11-27T18:38:39.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7609a1c1-676f-4fa2-81f1-2292231523dd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53852024-11-27T18:38:39.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7609a1c1-676f-4fa2-81f1-2292231523dd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53862024-11-27T18:38:40.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c933aef-868d-4249-9a64-02ba46ad00fa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53872024-11-27T18:38:40.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c933aef-868d-4249-9a64-02ba46ad00fa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53882024-11-27T18:38:40.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c933aef-868d-4249-9a64-02ba46ad00fa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
53892024-11-27T18:38:41.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
53902024-11-27T18:38:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53912024-11-27T18:38:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53922024-11-27T18:38:41.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
53932024-11-27T18:38:41.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53942024-11-27T18:38:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53952024-11-27T18:38:41.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53962024-11-27T18:38:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53972024-11-27T18:38:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53982024-11-27T18:38:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53992024-11-27T18:38:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54002024-11-27T18:38:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54012024-11-27T18:38:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.468172ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54022024-11-27T18:38:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54032024-11-27T18:38:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54042024-11-27T18:38:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54052024-11-27T18:38:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
54062024-11-27T18:38:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54072024-11-27T18:38:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54082024-11-27T18:38:41.409ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
54092024-11-27T18:38:41.409ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.278961ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
54102024-11-27T18:38:41.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4ce543c-766a-46d5-8d58-c50b4a90a266 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54112024-11-27T18:38:41.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4ce543c-766a-46d5-8d58-c50b4a90a266 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54122024-11-27T18:38:41.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4ce543c-766a-46d5-8d58-c50b4a90a266 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54132024-11-27T18:38:42.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 822e016b-8985-48ea-8be5-b04861f915fe roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54142024-11-27T18:38:42.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 822e016b-8985-48ea-8be5-b04861f915fe resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54152024-11-27T18:38:42.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 822e016b-8985-48ea-8be5-b04861f915fe response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54162024-11-27T18:38:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 75fa59f7-668d-4ffd-9360-900de780d325 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
54172024-11-27T18:38:43.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 75fa59f7-668d-4ffd-9360-900de780d325 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
54182024-11-27T18:38:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 75fa59f7-668d-4ffd-9360-900de780d325 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
54192024-11-27T18:38:43.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 39ae4e73-cafc-43b0-a4ea-05e96454c0ff roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
54202024-11-27T18:38:43.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 39ae4e73-cafc-43b0-a4ea-05e96454c0ff resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
54212024-11-27T18:38:43.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 39ae4e73-cafc-43b0-a4ea-05e96454c0ff response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
54222024-11-27T18:38:43.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = e078366e-b9e3-4b4d-943b-3ebf746f439e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
54232024-11-27T18:38:43.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 01295df7-3ff5-4e24-8fdb-57ab845ecf85 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54242024-11-27T18:38:43.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 01295df7-3ff5-4e24-8fdb-57ab845ecf85 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54252024-11-27T18:38:43.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 01295df7-3ff5-4e24-8fdb-57ab845ecf85 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54262024-11-27T18:38:44.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72748822-70a8-486d-83fb-c927aa958e32 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54272024-11-27T18:38:44.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72748822-70a8-486d-83fb-c927aa958e32 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54282024-11-27T18:38:44.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72748822-70a8-486d-83fb-c927aa958e32 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54292024-11-27T18:38:45.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3cc3686-f232-45ea-8865-378adc5bc521 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54302024-11-27T18:38:45.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3cc3686-f232-45ea-8865-378adc5bc521 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54312024-11-27T18:38:45.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3cc3686-f232-45ea-8865-378adc5bc521 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54322024-11-27T18:38:46.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc606c1f-f187-40f4-91ea-046d3fbf67e4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54332024-11-27T18:38:46.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc606c1f-f187-40f4-91ea-046d3fbf67e4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54342024-11-27T18:38:46.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc606c1f-f187-40f4-91ea-046d3fbf67e4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54352024-11-27T18:38:47.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57ace220-74b3-4ed7-92d4-0d9c22d0a4eb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54362024-11-27T18:38:47.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57ace220-74b3-4ed7-92d4-0d9c22d0a4eb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54372024-11-27T18:38:47.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57ace220-74b3-4ed7-92d4-0d9c22d0a4eb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54382024-11-27T18:38:48.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9136a72e-5f25-420d-a9be-5b563a2ff2e6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54392024-11-27T18:38:48.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9136a72e-5f25-420d-a9be-5b563a2ff2e6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54402024-11-27T18:38:48.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9136a72e-5f25-420d-a9be-5b563a2ff2e6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54412024-11-27T18:38:49.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b68f437-ddfe-4755-af4b-8287209b0e8d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54422024-11-27T18:38:49.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b68f437-ddfe-4755-af4b-8287209b0e8d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54432024-11-27T18:38:49.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b68f437-ddfe-4755-af4b-8287209b0e8d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54442024-11-27T18:38:50.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e499c5ca-fd6a-4efb-b57b-4c6b83901027 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54452024-11-27T18:38:50.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e499c5ca-fd6a-4efb-b57b-4c6b83901027 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54462024-11-27T18:38:50.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e499c5ca-fd6a-4efb-b57b-4c6b83901027 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54472024-11-27T18:38:51.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
54482024-11-27T18:38:51.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54492024-11-27T18:38:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54502024-11-27T18:38:51.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
54512024-11-27T18:38:51.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54522024-11-27T18:38:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54532024-11-27T18:38:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-11-27T18:38:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54552024-11-27T18:38:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54562024-11-27T18:38:51.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.3551ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54572024-11-27T18:38:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54582024-11-27T18:38:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54592024-11-27T18:38:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54602024-11-27T18:38:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612024-11-27T18:38:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622024-11-27T18:38:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-11-27T18:38:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
54642024-11-27T18:38:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54652024-11-27T18:38:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54662024-11-27T18:38:51.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
54672024-11-27T18:38:51.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.911121ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
54682024-11-27T18:38:51.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e5ac03e-f120-419e-a578-7382eb490672 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54692024-11-27T18:38:51.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e5ac03e-f120-419e-a578-7382eb490672 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54702024-11-27T18:38:51.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1e5ac03e-f120-419e-a578-7382eb490672 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54712024-11-27T18:38:52.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ef9f00b-23b3-4abe-b469-b5e3a72a2542 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54722024-11-27T18:38:52.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ef9f00b-23b3-4abe-b469-b5e3a72a2542 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54732024-11-27T18:38:52.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ef9f00b-23b3-4abe-b469-b5e3a72a2542 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54742024-11-27T18:38:53.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 919 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 5e009dba-02dd-4c4a-bfe8-8041e6b7a412 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
54752024-11-27T18:38:53.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea741516-f337-4e83-ad18-5e0cde0c8f61 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54762024-11-27T18:38:53.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea741516-f337-4e83-ad18-5e0cde0c8f61 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54772024-11-27T18:38:53.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea741516-f337-4e83-ad18-5e0cde0c8f61 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54782024-11-27T18:38:54.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e13aade-7e14-40cf-93a0-e1ebcb4a2526 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54792024-11-27T18:38:54.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e13aade-7e14-40cf-93a0-e1ebcb4a2526 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54802024-11-27T18:38:54.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e13aade-7e14-40cf-93a0-e1ebcb4a2526 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54812024-11-27T18:38:56.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0629841a-eef7-4795-9fb6-557bac002695 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54822024-11-27T18:38:56.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0629841a-eef7-4795-9fb6-557bac002695 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54832024-11-27T18:38:56.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0629841a-eef7-4795-9fb6-557bac002695 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54842024-11-27T18:38:57.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e06ad19a-e79f-461a-9937-1798ff5c3aae roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54852024-11-27T18:38:57.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e06ad19a-e79f-461a-9937-1798ff5c3aae resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54862024-11-27T18:38:57.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e06ad19a-e79f-461a-9937-1798ff5c3aae response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54872024-11-27T18:38:58.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9387190-60f8-4fa8-96af-eac51b6d6c34 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54882024-11-27T18:38:58.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9387190-60f8-4fa8-96af-eac51b6d6c34 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54892024-11-27T18:38:58.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9387190-60f8-4fa8-96af-eac51b6d6c34 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54902024-11-27T18:38:59.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfdd94c-ed5e-4b54-b75b-ecf3a3d2eed6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54912024-11-27T18:38:59.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfdd94c-ed5e-4b54-b75b-ecf3a3d2eed6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54922024-11-27T18:38:59.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfdd94c-ed5e-4b54-b75b-ecf3a3d2eed6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54932024-11-27T18:39:00.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6b56bc0a-b74e-4286-8f6d-a854136509bb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54942024-11-27T18:39:00.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6b56bc0a-b74e-4286-8f6d-a854136509bb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54952024-11-27T18:39:00.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6b56bc0a-b74e-4286-8f6d-a854136509bb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54962024-11-27T18:39:01.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2fd0d6d4-029e-4825-a2fd-95ce22320a85 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54972024-11-27T18:39:01.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2fd0d6d4-029e-4825-a2fd-95ce22320a85 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54982024-11-27T18:39:01.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2fd0d6d4-029e-4825-a2fd-95ce22320a85 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
54992024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
55002024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
55012024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55022024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55032024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55042024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
55052024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
55062024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55072024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55082024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
55092024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55102024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55112024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55122024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55132024-11-27T18:39:01.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55142024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55152024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55162024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55172024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55182024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
55192024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55202024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55212024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55222024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55232024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55242024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55252024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55262024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55272024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55282024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55292024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55302024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55312024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55322024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55332024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55342024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55352024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55362024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55372024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55382024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55392024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55402024-11-27T18:39:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55412024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
55422024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55432024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55442024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55452024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55462024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55472024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55482024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55492024-11-27T18:39:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55502024-11-27T18:39:01.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512024-11-27T18:39:01.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55522024-11-27T18:39:01.394ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.657765ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55532024-11-27T18:39:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55542024-11-27T18:39:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55552024-11-27T18:39:01.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55562024-11-27T18:39:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55572024-11-27T18:39:01.398ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55582024-11-27T18:39:01.398ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55592024-11-27T18:39:01.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55602024-11-27T18:39:01.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612024-11-27T18:39:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55622024-11-27T18:39:01.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 396768440 } })
55632024-11-27T18:39:01.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
55642024-11-27T18:39:01.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-11-27T18:39:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55662024-11-27T18:39:01.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55672024-11-27T18:39:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55682024-11-27T18:39:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55692024-11-27T18:39:01.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55702024-11-27T18:39:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55712024-11-27T18:39:01.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55722024-11-27T18:39:01.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55732024-11-27T18:39:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55742024-11-27T18:39:01.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 402075509 } })
55752024-11-27T18:39:01.404ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
55762024-11-27T18:39:01.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55772024-11-27T18:39:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55782024-11-27T18:39:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55792024-11-27T18:39:01.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55802024-11-27T18:39:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55812024-11-27T18:39:01.406ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55822024-11-27T18:39:01.406ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55832024-11-27T18:39:01.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55842024-11-27T18:39:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55852024-11-27T18:39:01.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55862024-11-27T18:39:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55872024-11-27T18:39:01.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882024-11-27T18:39:01.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55892024-11-27T18:39:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55902024-11-27T18:39:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
55912024-11-27T18:39:01.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55922024-11-27T18:39:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55932024-11-27T18:39:01.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55942024-11-27T18:39:01.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55952024-11-27T18:39:01.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55962024-11-27T18:39:01.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55972024-11-27T18:39:01.427ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
55982024-11-27T18:39:01.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.605942ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
55992024-11-27T18:39:01.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.254692ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
56002024-11-27T18:39:01.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56012024-11-27T18:39:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56022024-11-27T18:39:01.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56032024-11-27T18:39:01.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56042024-11-27T18:39:01.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56052024-11-27T18:39:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56062024-11-27T18:39:01.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56072024-11-27T18:39:01.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56082024-11-27T18:39:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56092024-11-27T18:39:01.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.280225ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
56102024-11-27T18:39:01.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56112024-11-27T18:39:01.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56122024-11-27T18:39:01.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56132024-11-27T18:39:01.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 442465187 } })
56142024-11-27T18:39:01.445ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
56152024-11-27T18:39:01.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56162024-11-27T18:39:01.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56172024-11-27T18:39:01.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.389801ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56182024-11-27T18:39:01.451ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56192024-11-27T18:39:01.451ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56202024-11-27T18:39:01.451ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.171692ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56212024-11-27T18:39:01.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56222024-11-27T18:39:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56232024-11-27T18:39:01.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56242024-11-27T18:39:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56252024-11-27T18:39:01.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56262024-11-27T18:39:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
56272024-11-27T18:39:01.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56282024-11-27T18:39:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56292024-11-27T18:39:01.465ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.898946ms iteration = 10 status = 0
56302024-11-27T18:39:01.465ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56312024-11-27T18:39:01.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.437728ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56322024-11-27T18:39:01.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.165825ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56332024-11-27T18:39:01.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-11-27T18:39:01.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56352024-11-27T18:39:01.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56362024-11-27T18:39:01.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56372024-11-27T18:39:01.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56382024-11-27T18:39:01.471ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56392024-11-27T18:39:01.472ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a2cb691-64c2-4cb8-97e3-6e1047978d87", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56402024-11-27T18:39:01.472ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56412024-11-27T18:39:01.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.777572ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56422024-11-27T18:39:01.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56432024-11-27T18:39:01.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.370463ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56442024-11-27T18:39:01.492ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56452024-11-27T18:39:01.492ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56462024-11-27T18:39:01.492ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d3d40d7-17c2-4e89-89b3-a8d301e1b286", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56472024-11-27T18:39:01.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56482024-11-27T18:39:01.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56492024-11-27T18:39:01.507ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
56502024-11-27T18:39:01.507ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56512024-11-27T18:39:01.507ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "463e1173-aa50-4c76-9bde-d9ae928eba4c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56522024-11-27T18:39:01.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56532024-11-27T18:39:01.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
56542024-11-27T18:39:01.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56552024-11-27T18:39:01.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56562024-11-27T18:39:01.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56572024-11-27T18:39:01.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56582024-11-27T18:39:01.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56592024-11-27T18:39:01.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56602024-11-27T18:39:01.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56612024-11-27T18:39:01.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56622024-11-27T18:39:01.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632024-11-27T18:39:01.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56642024-11-27T18:39:01.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56652024-11-27T18:39:01.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56662024-11-27T18:39:01.525ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.059957ms iteration = 12 status = {"physical_disks_added":0}
56672024-11-27T18:39:01.537ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 146.42904ms iteration = 10 status = {}
56682024-11-27T18:39:01.576ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56692024-11-27T18:39:01.576ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45755f90-fce2-4d15-bde5-d75cb5f81e0e", "content-length": "1", "date": "Wed, 27 Nov 2024 18:39:00 GMT"} })
56702024-11-27T18:39:01.577ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56712024-11-27T18:39:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56722024-11-27T18:39:01.579ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 187.640602ms iteration = 10 status = null
56732024-11-27T18:39:01.621ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56742024-11-27T18:39:01.621ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56752024-11-27T18:39:01.622ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f286ae2-d66a-4361-9091-466c2409bc72", "content-length": "372", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56762024-11-27T18:39:01.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56772024-11-27T18:39:01.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56782024-11-27T18:39:01.640ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56792024-11-27T18:39:01.640ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "58bb7de7-149c-49ff-9672-a96a05b9bd0a", "content-length": "691", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56802024-11-27T18:39:01.640ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56812024-11-27T18:39:01.640ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56822024-11-27T18:39:01.640ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56832024-11-27T18:39:01.642ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.382496ms iteration = 10 status = {}
56842024-11-27T18:39:01.658ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56852024-11-27T18:39:01.658ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56862024-11-27T18:39:01.658ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0da6929a-05ad-46b2-bbdd-289c4d47d61e", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56872024-11-27T18:39:01.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56882024-11-27T18:39:01.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56892024-11-27T18:39:01.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56902024-11-27T18:39:01.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56912024-11-27T18:39:01.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56922024-11-27T18:39:01.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56932024-11-27T18:39:01.667ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56942024-11-27T18:39:01.667ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56952024-11-27T18:39:01.667ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0db90e0a-462f-4720-adfc-b117c4627a54", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
56962024-11-27T18:39:01.669ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.099422ms iteration = 10 status = {}
56972024-11-27T18:39:01.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56982024-11-27T18:39:01.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56992024-11-27T18:39:01.694ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
57002024-11-27T18:39:01.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57012024-11-27T18:39:01.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57022024-11-27T18:39:01.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57032024-11-27T18:39:01.706ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ab5a51c-7912-43d8-8748-ff3f975490bd", "content-length": "134", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
57042024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57052024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
57062024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57072024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57082024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57092024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57102024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57112024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57122024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57132024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57142024-11-27T18:39:01.706ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
57152024-11-27T18:39:01.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57162024-11-27T18:39:01.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57172024-11-27T18:39:01.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57182024-11-27T18:39:01.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6f11df7-7fa3-4bd8-9e66-a02fb995e059", "content-length": "2", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
57192024-11-27T18:39:01.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57202024-11-27T18:39:01.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5a5d76-2b9b-472e-91d8-5c55904d2509", "content-length": "52", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
57212024-11-27T18:39:01.708ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
57222024-11-27T18:39:01.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57232024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db8f9e09-b96d-4010-94d3-8d822e954f16", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
57242024-11-27T18:39:01.808ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
57252024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57262024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a295102-0c5e-466d-a17f-50b2b3c4427d", "content-length": "682", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
57272024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57282024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57292024-11-27T18:39:01.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57302024-11-27T18:39:01.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57312024-11-27T18:39:01.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57322024-11-27T18:39:01.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57332024-11-27T18:39:01.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57342024-11-27T18:39:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57352024-11-27T18:39:01.826ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 435.151969ms iteration = 10 status = {}
57362024-11-27T18:39:02.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abcd52cd-6f31-4cae-8659-fecd1e5610d2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57372024-11-27T18:39:02.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abcd52cd-6f31-4cae-8659-fecd1e5610d2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57382024-11-27T18:39:02.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abcd52cd-6f31-4cae-8659-fecd1e5610d2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57392024-11-27T18:39:02.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 31e81e86-cf1d-4f61-bfeb-522048f42012 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
57402024-11-27T18:39:02.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 31e81e86-cf1d-4f61-bfeb-522048f42012 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
57412024-11-27T18:39:02.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 31e81e86-cf1d-4f61-bfeb-522048f42012 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
57422024-11-27T18:39:03.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b79bec10-93eb-42a1-b847-b5e815a3eab5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57432024-11-27T18:39:03.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b79bec10-93eb-42a1-b847-b5e815a3eab5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57442024-11-27T18:39:03.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b79bec10-93eb-42a1-b847-b5e815a3eab5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57452024-11-27T18:39:03.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 628 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a61097da-f44c-4d20-92d0-1bf2b695a12f response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
57462024-11-27T18:39:04.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57db15b0-7038-4ef7-870d-f2ab8008d625 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57472024-11-27T18:39:04.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57db15b0-7038-4ef7-870d-f2ab8008d625 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57482024-11-27T18:39:04.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57db15b0-7038-4ef7-870d-f2ab8008d625 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57492024-11-27T18:39:05.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e4ba86-0a6b-49b3-bc5b-f45b6376da6f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57502024-11-27T18:39:05.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e4ba86-0a6b-49b3-bc5b-f45b6376da6f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57512024-11-27T18:39:05.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 99e4ba86-0a6b-49b3-bc5b-f45b6376da6f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57522024-11-27T18:39:06.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d11d1671-a17b-49f6-b98b-e1391c7192bb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57532024-11-27T18:39:06.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d11d1671-a17b-49f6-b98b-e1391c7192bb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57542024-11-27T18:39:06.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d11d1671-a17b-49f6-b98b-e1391c7192bb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57552024-11-27T18:39:07.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72a193c4-223e-49a2-9b5f-c80c4b663056 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57562024-11-27T18:39:07.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72a193c4-223e-49a2-9b5f-c80c4b663056 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57572024-11-27T18:39:07.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72a193c4-223e-49a2-9b5f-c80c4b663056 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57582024-11-27T18:39:08.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c593a1e7-ce05-4ea3-8f9e-1c05f92b3260 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57592024-11-27T18:39:08.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c593a1e7-ce05-4ea3-8f9e-1c05f92b3260 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57602024-11-27T18:39:08.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c593a1e7-ce05-4ea3-8f9e-1c05f92b3260 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57612024-11-27T18:39:09.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3f4a499f-a157-41a0-bc00-b421f96954ad roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57622024-11-27T18:39:09.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3f4a499f-a157-41a0-bc00-b421f96954ad resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57632024-11-27T18:39:09.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3f4a499f-a157-41a0-bc00-b421f96954ad response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57642024-11-27T18:39:10.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6008c5d7-5161-46f1-8224-b633b7fefc5b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57652024-11-27T18:39:10.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6008c5d7-5161-46f1-8224-b633b7fefc5b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57662024-11-27T18:39:10.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6008c5d7-5161-46f1-8224-b633b7fefc5b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57672024-11-27T18:39:11.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8434e70-5187-44e5-80b6-45f651fb51d3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57682024-11-27T18:39:11.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8434e70-5187-44e5-80b6-45f651fb51d3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57692024-11-27T18:39:11.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8434e70-5187-44e5-80b6-45f651fb51d3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57702024-11-27T18:39:11.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
57712024-11-27T18:39:11.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57722024-11-27T18:39:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57732024-11-27T18:39:11.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
57742024-11-27T18:39:11.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57752024-11-27T18:39:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57762024-11-27T18:39:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57772024-11-27T18:39:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57782024-11-27T18:39:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57792024-11-27T18:39:11.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.120756ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57802024-11-27T18:39:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57812024-11-27T18:39:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57822024-11-27T18:39:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57832024-11-27T18:39:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57842024-11-27T18:39:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57852024-11-27T18:39:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57862024-11-27T18:39:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
57872024-11-27T18:39:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57882024-11-27T18:39:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57892024-11-27T18:39:11.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
57902024-11-27T18:39:11.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.073307ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
57912024-11-27T18:39:12.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3233ac5a-1ab9-4f9f-9704-3d95aa47eed6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57922024-11-27T18:39:12.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3233ac5a-1ab9-4f9f-9704-3d95aa47eed6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57932024-11-27T18:39:12.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3233ac5a-1ab9-4f9f-9704-3d95aa47eed6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57942024-11-27T18:39:13.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f131cdbb-65d0-4600-a1a4-e88279c38bf0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57952024-11-27T18:39:13.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f131cdbb-65d0-4600-a1a4-e88279c38bf0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57962024-11-27T18:39:13.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f131cdbb-65d0-4600-a1a4-e88279c38bf0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
57972024-11-27T18:39:13.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = c535a1f9-d704-462a-bf03-0a7d60238f9d roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
57982024-11-27T18:39:13.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = c535a1f9-d704-462a-bf03-0a7d60238f9d resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
57992024-11-27T18:39:13.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = c535a1f9-d704-462a-bf03-0a7d60238f9d response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
58002024-11-27T18:39:13.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 23e3a4c7-45ff-4f5d-ae29-92ccd9d4af32 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
58012024-11-27T18:39:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 23e3a4c7-45ff-4f5d-ae29-92ccd9d4af32 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
58022024-11-27T18:39:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47778 req_id = 23e3a4c7-45ff-4f5d-ae29-92ccd9d4af32 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
58032024-11-27T18:39:13.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = b5f00859-9ec1-40bb-a6e1-95d84a3eb40e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
58042024-11-27T18:39:14.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b44fd6fc-e626-4d6e-b1fd-657fd931bc0f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58052024-11-27T18:39:14.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b44fd6fc-e626-4d6e-b1fd-657fd931bc0f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58062024-11-27T18:39:14.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b44fd6fc-e626-4d6e-b1fd-657fd931bc0f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58072024-11-27T18:39:15.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dab287a-c74a-453e-aab8-39fb7d78747b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58082024-11-27T18:39:15.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dab287a-c74a-453e-aab8-39fb7d78747b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58092024-11-27T18:39:15.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dab287a-c74a-453e-aab8-39fb7d78747b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58102024-11-27T18:39:16.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 045cb2e1-b855-4470-a711-1dad7bf15aa6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58112024-11-27T18:39:16.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 045cb2e1-b855-4470-a711-1dad7bf15aa6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58122024-11-27T18:39:16.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 045cb2e1-b855-4470-a711-1dad7bf15aa6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58132024-11-27T18:39:17.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 789a6b86-45c7-465e-ad57-8b1743206828 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58142024-11-27T18:39:17.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 789a6b86-45c7-465e-ad57-8b1743206828 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58152024-11-27T18:39:17.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 789a6b86-45c7-465e-ad57-8b1743206828 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58162024-11-27T18:39:18.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e41c6ec8-c298-4a54-8d48-991eed67e816 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58172024-11-27T18:39:18.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e41c6ec8-c298-4a54-8d48-991eed67e816 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58182024-11-27T18:39:18.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e41c6ec8-c298-4a54-8d48-991eed67e816 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58192024-11-27T18:39:19.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9fde3b7a-4a9e-4fdb-aa3f-a1b0cbfe0c25 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58202024-11-27T18:39:19.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9fde3b7a-4a9e-4fdb-aa3f-a1b0cbfe0c25 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58212024-11-27T18:39:19.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9fde3b7a-4a9e-4fdb-aa3f-a1b0cbfe0c25 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58222024-11-27T18:39:20.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a4ac9cc-dfe7-4c12-a3d9-224010f59c0d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58232024-11-27T18:39:20.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a4ac9cc-dfe7-4c12-a3d9-224010f59c0d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58242024-11-27T18:39:20.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a4ac9cc-dfe7-4c12-a3d9-224010f59c0d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58252024-11-27T18:39:21.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58262024-11-27T18:39:21.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58272024-11-27T18:39:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58282024-11-27T18:39:21.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58292024-11-27T18:39:21.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58302024-11-27T18:39:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58312024-11-27T18:39:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58322024-11-27T18:39:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58332024-11-27T18:39:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58342024-11-27T18:39:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58352024-11-27T18:39:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58362024-11-27T18:39:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.702495ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58372024-11-27T18:39:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58382024-11-27T18:39:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58392024-11-27T18:39:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58402024-11-27T18:39:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412024-11-27T18:39:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
58422024-11-27T18:39:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58432024-11-27T18:39:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58442024-11-27T18:39:21.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
58452024-11-27T18:39:21.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.128653ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
58462024-11-27T18:39:21.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 877df445-47d1-4d89-9c70-4af6745c454c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58472024-11-27T18:39:21.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 877df445-47d1-4d89-9c70-4af6745c454c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58482024-11-27T18:39:21.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 877df445-47d1-4d89-9c70-4af6745c454c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58492024-11-27T18:39:22.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc96366-f3fb-40e1-8c92-8bf02ce1a39e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58502024-11-27T18:39:22.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc96366-f3fb-40e1-8c92-8bf02ce1a39e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58512024-11-27T18:39:22.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4dc96366-f3fb-40e1-8c92-8bf02ce1a39e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58522024-11-27T18:39:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 712 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 76f1f506-619f-4ce5-9634-f92daaebe8bb response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
58532024-11-27T18:39:23.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0094bc7e-90a9-4e50-b77c-31aa607a4c24 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58542024-11-27T18:39:23.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0094bc7e-90a9-4e50-b77c-31aa607a4c24 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58552024-11-27T18:39:23.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0094bc7e-90a9-4e50-b77c-31aa607a4c24 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58562024-11-27T18:39:24.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45a88967-ee61-42da-907b-dc652adadf2f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58572024-11-27T18:39:24.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45a88967-ee61-42da-907b-dc652adadf2f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58582024-11-27T18:39:24.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45a88967-ee61-42da-907b-dc652adadf2f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58592024-11-27T18:39:25.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e8789426-fdde-48a5-a772-949d978b934f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58602024-11-27T18:39:25.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e8789426-fdde-48a5-a772-949d978b934f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58612024-11-27T18:39:25.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e8789426-fdde-48a5-a772-949d978b934f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58622024-11-27T18:39:26.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1e6bbb7-25d7-44f0-840e-2dee5c94a380 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58632024-11-27T18:39:26.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1e6bbb7-25d7-44f0-840e-2dee5c94a380 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58642024-11-27T18:39:26.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b1e6bbb7-25d7-44f0-840e-2dee5c94a380 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58652024-11-27T18:39:27.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c4d8a03-bb37-4950-8015-46b8ce49b748 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58662024-11-27T18:39:27.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c4d8a03-bb37-4950-8015-46b8ce49b748 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58672024-11-27T18:39:27.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6c4d8a03-bb37-4950-8015-46b8ce49b748 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58682024-11-27T18:39:28.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccb38e02-4864-4528-b3db-b222ba88b290 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58692024-11-27T18:39:28.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccb38e02-4864-4528-b3db-b222ba88b290 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58702024-11-27T18:39:28.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ccb38e02-4864-4528-b3db-b222ba88b290 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58712024-11-27T18:39:29.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8850f1d1-7262-4af2-9d97-cefa46657727 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58722024-11-27T18:39:29.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8850f1d1-7262-4af2-9d97-cefa46657727 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58732024-11-27T18:39:29.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8850f1d1-7262-4af2-9d97-cefa46657727 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58742024-11-27T18:39:30.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5dc5dd2f-d182-4dd2-862c-a057032e9dc6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58752024-11-27T18:39:30.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5dc5dd2f-d182-4dd2-862c-a057032e9dc6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58762024-11-27T18:39:30.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5dc5dd2f-d182-4dd2-862c-a057032e9dc6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
58772024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
58782024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
58792024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58802024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58812024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
58822024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58832024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
58842024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58852024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58862024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
58872024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
58882024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58892024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
58902024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58912024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
58922024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58932024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
58942024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
58952024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
58962024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
58972024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58982024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58992024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59002024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
59012024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59022024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
59032024-11-27T18:39:31.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:29:31.391484284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59042024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59052024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
59062024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59072024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59082024-11-27T18:39:31.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59092024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59102024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59112024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59122024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59132024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59142024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
59152024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59162024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
59172024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59182024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59192024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59202024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59212024-11-27T18:39:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
59222024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.62\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
59232024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59242024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
59252024-11-27T18:39:31.391ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
59262024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59272024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59282024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59292024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
59302024-11-27T18:39:31.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59312024-11-27T18:39:31.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59322024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
59332024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59342024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59352024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59362024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59372024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59382024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59392024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59402024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59412024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59422024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59432024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59442024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
59452024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59462024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59472024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
59482024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59492024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59502024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59512024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59522024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59532024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59542024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
59552024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59562024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
59572024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59582024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59592024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59602024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59612024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59622024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59632024-11-27T18:39:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 389521493 } })
59642024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59652024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59662024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59672024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59682024-11-27T18:39:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 389825997 } })
59692024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
59702024-11-27T18:39:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.083776ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
59712024-11-27T18:39:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
59722024-11-27T18:39:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 973.255\u{b5}s iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
59732024-11-27T18:39:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742024-11-27T18:39:31.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59752024-11-27T18:39:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.829597ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59762024-11-27T18:39:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59772024-11-27T18:39:31.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59782024-11-27T18:39:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59792024-11-27T18:39:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59802024-11-27T18:39:31.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59812024-11-27T18:39:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59822024-11-27T18:39:31.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59832024-11-27T18:39:31.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 396930722 } })
59842024-11-27T18:39:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.583867ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
59852024-11-27T18:39:31.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
59862024-11-27T18:39:31.400ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:29:31.391484284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59872024-11-27T18:39:31.400ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.058494ms iteration = 6 status = {"expiration":"2024-11-27T18:29:31.391484284Z","pruned":[]}
59882024-11-27T18:39:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59892024-11-27T18:39:31.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59902024-11-27T18:39:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59912024-11-27T18:39:31.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-11-27T18:39:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.239487ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
59932024-11-27T18:39:31.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59942024-11-27T18:39:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59952024-11-27T18:39:31.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59962024-11-27T18:39:31.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-11-27T18:39:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59982024-11-27T18:39:31.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59992024-11-27T18:39:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60002024-11-27T18:39:31.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60012024-11-27T18:39:31.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60022024-11-27T18:39:31.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60032024-11-27T18:39:31.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60042024-11-27T18:39:31.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60052024-11-27T18:39:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60062024-11-27T18:39:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60072024-11-27T18:39:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60082024-11-27T18:39:31.408ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60092024-11-27T18:39:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60102024-11-27T18:39:31.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60112024-11-27T18:39:31.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 408607546 } })
60122024-11-27T18:39:31.411ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
60132024-11-27T18:39:31.411ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
60142024-11-27T18:39:31.411ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
60152024-11-27T18:39:31.411ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.685372ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
60162024-11-27T18:39:31.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60172024-11-27T18:39:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60182024-11-27T18:39:31.412ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60192024-11-27T18:39:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60202024-11-27T18:39:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60212024-11-27T18:39:31.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60222024-11-27T18:39:31.413ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 410324811 } })
60232024-11-27T18:39:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60242024-11-27T18:39:31.413ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
60252024-11-27T18:39:31.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60262024-11-27T18:39:31.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60272024-11-27T18:39:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60282024-11-27T18:39:31.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292024-11-27T18:39:31.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60302024-11-27T18:39:31.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60312024-11-27T18:39:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60322024-11-27T18:39:31.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60332024-11-27T18:39:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60342024-11-27T18:39:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60352024-11-27T18:39:31.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60362024-11-27T18:39:31.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60372024-11-27T18:39:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60382024-11-27T18:39:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60392024-11-27T18:39:31.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-11-27T18:39:31.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60412024-11-27T18:39:31.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 31.620689ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
60422024-11-27T18:39:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60432024-11-27T18:39:31.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60442024-11-27T18:39:31.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60452024-11-27T18:39:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60462024-11-27T18:39:31.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60472024-11-27T18:39:31.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
60482024-11-27T18:39:31.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60492024-11-27T18:39:31.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60502024-11-27T18:39:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60512024-11-27T18:39:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60522024-11-27T18:39:31.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60532024-11-27T18:39:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60542024-11-27T18:39:31.426ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60552024-11-27T18:39:31.426ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.811546ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60562024-11-27T18:39:31.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60572024-11-27T18:39:31.428ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60582024-11-27T18:39:31.428ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60592024-11-27T18:39:31.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60602024-11-27T18:39:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60612024-11-27T18:39:31.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60622024-11-27T18:39:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60632024-11-27T18:39:31.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60642024-11-27T18:39:31.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60652024-11-27T18:39:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60662024-11-27T18:39:31.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60672024-11-27T18:39:31.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
60682024-11-27T18:39:31.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.148633ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
60692024-11-27T18:39:31.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60702024-11-27T18:39:31.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60712024-11-27T18:39:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60722024-11-27T18:39:31.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60732024-11-27T18:39:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60742024-11-27T18:39:31.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60752024-11-27T18:39:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60762024-11-27T18:39:31.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60772024-11-27T18:39:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60782024-11-27T18:39:31.460ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60792024-11-27T18:39:31.460ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60802024-11-27T18:39:31.460ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
60812024-11-27T18:39:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.209336ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60822024-11-27T18:39:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60832024-11-27T18:39:31.461ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60842024-11-27T18:39:31.461ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60852024-11-27T18:39:31.461ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60862024-11-27T18:39:31.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60872024-11-27T18:39:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60882024-11-27T18:39:31.464ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60892024-11-27T18:39:31.464ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60902024-11-27T18:39:31.464ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60912024-11-27T18:39:31.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60922024-11-27T18:39:31.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60932024-11-27T18:39:31.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60942024-11-27T18:39:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60952024-11-27T18:39:31.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.364862ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60962024-11-27T18:39:31.526ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.91525ms iteration = 13 status = {"physical_disks_added":0}
60972024-11-27T18:39:31.545ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60982024-11-27T18:39:31.545ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60992024-11-27T18:39:31.545ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49e6665c-5509-41fe-869e-e255a38c8092", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
61002024-11-27T18:39:31.545ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61012024-11-27T18:39:31.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61022024-11-27T18:39:31.547ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61032024-11-27T18:39:31.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61042024-11-27T18:39:31.713ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.933742ms iteration = 11 status = {}
61052024-11-27T18:39:31.733ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61062024-11-27T18:39:31.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
61072024-11-27T18:39:31.742ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61082024-11-27T18:39:31.742ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd4856f-2637-43d4-bd10-db35aed62762", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
61092024-11-27T18:39:31.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61102024-11-27T18:39:31.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
61112024-11-27T18:39:31.748ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61122024-11-27T18:39:31.748ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61132024-11-27T18:39:31.749ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a45e260-3cc1-4155-bf50-68c4ed94c3a4", "content-length": "372", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
61142024-11-27T18:39:31.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61152024-11-27T18:39:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61162024-11-27T18:39:31.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61172024-11-27T18:39:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61182024-11-27T18:39:31.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61192024-11-27T18:39:31.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61202024-11-27T18:39:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61212024-11-27T18:39:31.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61222024-11-27T18:39:31.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61232024-11-27T18:39:31.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61242024-11-27T18:39:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61252024-11-27T18:39:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61262024-11-27T18:39:31.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61272024-11-27T18:39:31.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282024-11-27T18:39:31.758ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61292024-11-27T18:39:31.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61302024-11-27T18:39:31.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e907c88-8ae8-49a7-ab4a-17dd2f1c0b34 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
61312024-11-27T18:39:31.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e907c88-8ae8-49a7-ab4a-17dd2f1c0b34 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
61322024-11-27T18:39:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61332024-11-27T18:39:31.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61342024-11-27T18:39:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61352024-11-27T18:39:31.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61362024-11-27T18:39:31.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61372024-11-27T18:39:31.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61382024-11-27T18:39:31.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
61392024-11-27T18:39:31.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61402024-11-27T18:39:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61412024-11-27T18:39:31.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e907c88-8ae8-49a7-ab4a-17dd2f1c0b34 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
61422024-11-27T18:39:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61432024-11-27T18:39:31.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61442024-11-27T18:39:31.764ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61452024-11-27T18:39:31.764ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61462024-11-27T18:39:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61472024-11-27T18:39:31.764ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3158764-e6aa-4724-9727-680c39664047", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
61482024-11-27T18:39:31.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61492024-11-27T18:39:31.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61502024-11-27T18:39:31.767ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 376.331127ms iteration = 11 status = 0
61512024-11-27T18:39:31.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61522024-11-27T18:39:31.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61532024-11-27T18:39:31.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61542024-11-27T18:39:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61552024-11-27T18:39:31.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 396.579647ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61562024-11-27T18:39:31.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61572024-11-27T18:39:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61582024-11-27T18:39:31.789ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61592024-11-27T18:39:31.789ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61602024-11-27T18:39:31.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61612024-11-27T18:39:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61622024-11-27T18:39:31.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 401.653933ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61632024-11-27T18:39:31.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642024-11-27T18:39:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61652024-11-27T18:39:31.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61662024-11-27T18:39:31.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61672024-11-27T18:39:31.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61682024-11-27T18:39:31.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61692024-11-27T18:39:31.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61702024-11-27T18:39:31.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61712024-11-27T18:39:31.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61722024-11-27T18:39:31.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61732024-11-27T18:39:31.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61742024-11-27T18:39:31.818ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61752024-11-27T18:39:31.818ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61762024-11-27T18:39:31.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61772024-11-27T18:39:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61782024-11-27T18:39:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61792024-11-27T18:39:31.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61802024-11-27T18:39:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61812024-11-27T18:39:31.821ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61822024-11-27T18:39:31.821ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61832024-11-27T18:39:31.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 430.643542ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61842024-11-27T18:39:31.822ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "20d58a09-d057-49e4-b447-3f43ec4299f3", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
61852024-11-27T18:39:31.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61862024-11-27T18:39:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61872024-11-27T18:39:31.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61882024-11-27T18:39:31.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61892024-11-27T18:39:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61902024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61912024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61922024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61932024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61942024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61952024-11-27T18:39:31.826ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61962024-11-27T18:39:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61972024-11-27T18:39:31.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61982024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61992024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62002024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
62012024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 437.486044ms iteration = 6 status = {"generation":1}
62022024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62032024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62042024-11-27T18:39:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62052024-11-27T18:39:31.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62062024-11-27T18:39:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62072024-11-27T18:39:31.832ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62082024-11-27T18:39:31.832ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62092024-11-27T18:39:31.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 440.902834ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62102024-11-27T18:39:31.832ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62112024-11-27T18:39:31.832ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62122024-11-27T18:39:31.833ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "07a652a6-3d93-4062-a3ba-702971616025", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62132024-11-27T18:39:31.834ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.746202ms iteration = 11 status = {}
62142024-11-27T18:39:31.845ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62152024-11-27T18:39:31.845ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
62162024-11-27T18:39:31.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62172024-11-27T18:39:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62182024-11-27T18:39:31.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62192024-11-27T18:39:31.860ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
62202024-11-27T18:39:31.860ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 468.520684ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62212024-11-27T18:39:31.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62222024-11-27T18:39:31.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62232024-11-27T18:39:31.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b34dc59f-5183-4df7-8e38-452db833ed8b", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62242024-11-27T18:39:31.865ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62252024-11-27T18:39:31.866ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62262024-11-27T18:39:31.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 474.966609ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62272024-11-27T18:39:31.866ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8d31ae5c-973b-42bf-b5f0-5b7da96d9cb3", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62282024-11-27T18:39:31.866ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62292024-11-27T18:39:31.867ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "31614c19-28ee-4c42-99c8-fd68d7561e6c", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62302024-11-27T18:39:31.867ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62312024-11-27T18:39:31.869ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62322024-11-27T18:39:31.869ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.593968ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62332024-11-27T18:39:31.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62342024-11-27T18:39:31.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62352024-11-27T18:39:31.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62362024-11-27T18:39:31.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62372024-11-27T18:39:31.888ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62382024-11-27T18:39:31.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f47692b5-5abd-49bb-b20c-634c8e4ef1a0", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62392024-11-27T18:39:31.888ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62402024-11-27T18:39:31.890ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ca661eac-9491-42ff-af6d-b41b4d92e447", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62412024-11-27T18:39:31.890ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62422024-11-27T18:39:31.892ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62432024-11-27T18:39:31.892ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 501.345971ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62442024-11-27T18:39:31.933ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62452024-11-27T18:39:31.933ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "590a55bb-e01f-4102-88a0-4a6282f108f6", "content-length": "1", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62462024-11-27T18:39:31.935ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62472024-11-27T18:39:31.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62482024-11-27T18:39:31.940ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62492024-11-27T18:39:31.940ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f7c2df9-53ff-43e3-b10b-9cd8b40ff5fa", "content-length": "691", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62502024-11-27T18:39:31.940ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62512024-11-27T18:39:31.940ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62522024-11-27T18:39:31.940ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62532024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 551.095187ms iteration = 11 status = {}
62542024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
62552024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62562024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
62572024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 551.127738ms iteration = 6 status = {"generation":2}
62582024-11-27T18:39:31.943ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 550.922236ms iteration = 11 status = null
62592024-11-27T18:39:31.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62602024-11-27T18:39:31.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62612024-11-27T18:39:31.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62622024-11-27T18:39:31.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62632024-11-27T18:39:31.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62642024-11-27T18:39:31.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62652024-11-27T18:39:31.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62662024-11-27T18:39:31.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62672024-11-27T18:39:31.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62682024-11-27T18:39:31.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62692024-11-27T18:39:31.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62702024-11-27T18:39:31.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62712024-11-27T18:39:31.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62722024-11-27T18:39:31.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62732024-11-27T18:39:31.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62742024-11-27T18:39:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62752024-11-27T18:39:31.988ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
62762024-11-27T18:39:31.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62772024-11-27T18:39:31.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62782024-11-27T18:39:32.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62792024-11-27T18:39:32.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3187a0b6-44f5-4ebf-8359-790860da8d9a", "content-length": "134", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62802024-11-27T18:39:32.029ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62812024-11-27T18:39:32.029ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
62822024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62832024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62842024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62852024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62862024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62872024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62882024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62892024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62902024-11-27T18:39:32.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
62912024-11-27T18:39:32.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62922024-11-27T18:39:32.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62932024-11-27T18:39:32.034ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62942024-11-27T18:39:32.035ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab2b8342-6f9e-4aea-beb0-e034dd79cbff", "content-length": "2", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62952024-11-27T18:39:32.035ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62962024-11-27T18:39:32.035ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "11326d3b-eda4-41e0-a93f-f9bf9be24aa2", "content-length": "52", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
62972024-11-27T18:39:32.035ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
62982024-11-27T18:39:32.035ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62992024-11-27T18:39:32.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63002024-11-27T18:39:32.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63012024-11-27T18:39:32.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63022024-11-27T18:39:32.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63032024-11-27T18:39:32.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-11-27T18:39:32.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63052024-11-27T18:39:32.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63062024-11-27T18:39:32.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63072024-11-27T18:39:32.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63082024-11-27T18:39:32.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63092024-11-27T18:39:32.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63102024-11-27T18:39:32.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63112024-11-27T18:39:32.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122024-11-27T18:39:32.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63132024-11-27T18:39:32.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63142024-11-27T18:39:32.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63152024-11-27T18:39:32.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63162024-11-27T18:39:32.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63172024-11-27T18:39:32.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63182024-11-27T18:39:32.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63192024-11-27T18:39:32.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63202024-11-27T18:39:32.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63212024-11-27T18:39:32.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63222024-11-27T18:39:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63232024-11-27T18:39:32.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63242024-11-27T18:39:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63252024-11-27T18:39:32.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63262024-11-27T18:39:32.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63272024-11-27T18:39:32.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63282024-11-27T18:39:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63292024-11-27T18:39:32.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63302024-11-27T18:39:32.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63312024-11-27T18:39:32.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63322024-11-27T18:39:32.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63332024-11-27T18:39:32.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63342024-11-27T18:39:32.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63352024-11-27T18:39:32.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63362024-11-27T18:39:32.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63372024-11-27T18:39:32.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63382024-11-27T18:39:32.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63392024-11-27T18:39:32.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63402024-11-27T18:39:32.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63412024-11-27T18:39:32.132ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
63422024-11-27T18:39:32.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63432024-11-27T18:39:32.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63442024-11-27T18:39:32.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63452024-11-27T18:39:32.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63462024-11-27T18:39:32.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63472024-11-27T18:39:32.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63482024-11-27T18:39:32.139ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
63492024-11-27T18:39:32.139ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
63502024-11-27T18:39:32.139ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
63512024-11-27T18:39:32.179ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a6fc728-dd77-4bdf-a575-39f4ded821c5", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
63522024-11-27T18:39:32.179ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
63532024-11-27T18:39:32.179ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63542024-11-27T18:39:32.179ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b6c580f-4902-4e9d-a73b-cfe194d6b0a9", "content-length": "682", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
63552024-11-27T18:39:32.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63562024-11-27T18:39:32.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63572024-11-27T18:39:32.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63582024-11-27T18:39:32.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63592024-11-27T18:39:32.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63602024-11-27T18:39:32.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63612024-11-27T18:39:32.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63622024-11-27T18:39:32.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63632024-11-27T18:39:32.198ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 806.792778ms iteration = 11 status = {}
63642024-11-27T18:39:32.274ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
63652024-11-27T18:39:32.274ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
63662024-11-27T18:39:32.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63672024-11-27T18:39:32.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63682024-11-27T18:39:32.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63692024-11-27T18:39:32.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63702024-11-27T18:39:32.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712024-11-27T18:39:32.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
63722024-11-27T18:39:32.311ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
63732024-11-27T18:39:32.312ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3eda859f-9138-4a8b-9412-703ac657de95", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} })
63742024-11-27T18:39:32.314ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
63752024-11-27T18:39:32.314ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 922.511173ms
63762024-11-27T18:39:32.314ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 922.519734ms iteration = 2 status = {}
63772024-11-27T18:39:32.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a8e83b7-7357-42b6-a4f0-27a346e31ce6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
63782024-11-27T18:39:32.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a8e83b7-7357-42b6-a4f0-27a346e31ce6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
63792024-11-27T18:39:32.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a8e83b7-7357-42b6-a4f0-27a346e31ce6 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
63802024-11-27T18:39:32.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a91db124-0d32-4f83-a6eb-0c2118231818 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63812024-11-27T18:39:32.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a91db124-0d32-4f83-a6eb-0c2118231818 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63822024-11-27T18:39:32.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a91db124-0d32-4f83-a6eb-0c2118231818 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63832024-11-27T18:39:33.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = e88ba55d-a805-483f-bbf8-3e6eb8668600 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
63842024-11-27T18:39:33.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02d20721-15fc-4d65-9457-0c9d809b3033 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63852024-11-27T18:39:33.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02d20721-15fc-4d65-9457-0c9d809b3033 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63862024-11-27T18:39:33.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02d20721-15fc-4d65-9457-0c9d809b3033 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63872024-11-27T18:39:34.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c8699c2-bf92-4d7b-9ca7-a1f4b972eab5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63882024-11-27T18:39:34.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c8699c2-bf92-4d7b-9ca7-a1f4b972eab5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63892024-11-27T18:39:34.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c8699c2-bf92-4d7b-9ca7-a1f4b972eab5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63902024-11-27T18:39:35.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c3908bf-d9ad-4df3-bd2b-85cd3665ac1b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63912024-11-27T18:39:35.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c3908bf-d9ad-4df3-bd2b-85cd3665ac1b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63922024-11-27T18:39:35.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1c3908bf-d9ad-4df3-bd2b-85cd3665ac1b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63932024-11-27T18:39:36.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 620946c3-2535-42cf-8e36-5346e925cdc4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63942024-11-27T18:39:36.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 620946c3-2535-42cf-8e36-5346e925cdc4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63952024-11-27T18:39:36.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 620946c3-2535-42cf-8e36-5346e925cdc4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63962024-11-27T18:39:37.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38c98e3f-b518-4776-8664-30fff2ea6bd4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63972024-11-27T18:39:37.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38c98e3f-b518-4776-8664-30fff2ea6bd4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63982024-11-27T18:39:37.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 38c98e3f-b518-4776-8664-30fff2ea6bd4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
63992024-11-27T18:39:38.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72c654b7-bd3a-45af-be09-144fb8f01b47 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64002024-11-27T18:39:38.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72c654b7-bd3a-45af-be09-144fb8f01b47 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64012024-11-27T18:39:38.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 72c654b7-bd3a-45af-be09-144fb8f01b47 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64022024-11-27T18:39:39.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 04c60042-9718-4991-8bcf-033c49276c74 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64032024-11-27T18:39:39.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 04c60042-9718-4991-8bcf-033c49276c74 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64042024-11-27T18:39:39.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 04c60042-9718-4991-8bcf-033c49276c74 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64052024-11-27T18:39:40.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9b9cb0a1-eadb-4ba0-b65a-5b158401ca92 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64062024-11-27T18:39:40.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9b9cb0a1-eadb-4ba0-b65a-5b158401ca92 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64072024-11-27T18:39:40.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9b9cb0a1-eadb-4ba0-b65a-5b158401ca92 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64082024-11-27T18:39:41.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
64092024-11-27T18:39:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64102024-11-27T18:39:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64112024-11-27T18:39:41.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
64122024-11-27T18:39:41.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64132024-11-27T18:39:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64142024-11-27T18:39:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64152024-11-27T18:39:41.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64162024-11-27T18:39:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64172024-11-27T18:39:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64182024-11-27T18:39:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64192024-11-27T18:39:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64202024-11-27T18:39:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64212024-11-27T18:39:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64222024-11-27T18:39:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64232024-11-27T18:39:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
64242024-11-27T18:39:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64252024-11-27T18:39:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64262024-11-27T18:39:41.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
64272024-11-27T18:39:41.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.697556ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
64282024-11-27T18:39:41.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.583623ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64292024-11-27T18:39:41.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd27979-b6a8-4d27-a21b-24d815382cd4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64302024-11-27T18:39:41.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd27979-b6a8-4d27-a21b-24d815382cd4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64312024-11-27T18:39:41.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bbd27979-b6a8-4d27-a21b-24d815382cd4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64322024-11-27T18:39:42.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da90a54d-f54c-475b-a054-66799bdb2536 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64332024-11-27T18:39:42.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da90a54d-f54c-475b-a054-66799bdb2536 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64342024-11-27T18:39:43.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = da90a54d-f54c-475b-a054-66799bdb2536 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64352024-11-27T18:39:43.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = c91fbdb9-af2f-485a-93f4-5a94db7ce76a response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
64362024-11-27T18:39:44.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d45cc07-4ee6-4c5a-8640-9e9d2af13481 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64372024-11-27T18:39:44.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d45cc07-4ee6-4c5a-8640-9e9d2af13481 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64382024-11-27T18:39:44.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d45cc07-4ee6-4c5a-8640-9e9d2af13481 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64392024-11-27T18:39:45.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3692f23-329a-4aed-9599-85ba57a155ab roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64402024-11-27T18:39:45.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3692f23-329a-4aed-9599-85ba57a155ab resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64412024-11-27T18:39:45.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c3692f23-329a-4aed-9599-85ba57a155ab response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64422024-11-27T18:39:46.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89c1691e-d877-4a5c-a8e3-81f3b3288145 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64432024-11-27T18:39:46.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89c1691e-d877-4a5c-a8e3-81f3b3288145 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64442024-11-27T18:39:46.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89c1691e-d877-4a5c-a8e3-81f3b3288145 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64452024-11-27T18:39:47.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df6c34d-3a10-456b-ad60-5fb317f8a140 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64462024-11-27T18:39:47.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df6c34d-3a10-456b-ad60-5fb317f8a140 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64472024-11-27T18:39:47.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2df6c34d-3a10-456b-ad60-5fb317f8a140 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64482024-11-27T18:39:48.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a3bf4d9-b9a9-454c-9c00-9341462124ed roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64492024-11-27T18:39:48.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a3bf4d9-b9a9-454c-9c00-9341462124ed resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64502024-11-27T18:39:48.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7a3bf4d9-b9a9-454c-9c00-9341462124ed response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64512024-11-27T18:39:49.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d00105cc-58f1-42b3-9b9a-2b613847a91a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64522024-11-27T18:39:49.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d00105cc-58f1-42b3-9b9a-2b613847a91a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64532024-11-27T18:39:49.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d00105cc-58f1-42b3-9b9a-2b613847a91a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64542024-11-27T18:39:50.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d73619-3dd2-407f-8d3c-53204d3e434b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64552024-11-27T18:39:50.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d73619-3dd2-407f-8d3c-53204d3e434b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64562024-11-27T18:39:50.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d73619-3dd2-407f-8d3c-53204d3e434b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64572024-11-27T18:39:51.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af0761f1-8663-4639-b314-0a13c4b95882 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64582024-11-27T18:39:51.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af0761f1-8663-4639-b314-0a13c4b95882 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64592024-11-27T18:39:51.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = af0761f1-8663-4639-b314-0a13c4b95882 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64602024-11-27T18:39:51.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
64612024-11-27T18:39:51.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64622024-11-27T18:39:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64632024-11-27T18:39:51.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
64642024-11-27T18:39:51.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64652024-11-27T18:39:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64662024-11-27T18:39:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64672024-11-27T18:39:51.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64682024-11-27T18:39:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64692024-11-27T18:39:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64702024-11-27T18:39:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64712024-11-27T18:39:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64722024-11-27T18:39:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64732024-11-27T18:39:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64742024-11-27T18:39:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64752024-11-27T18:39:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
64762024-11-27T18:39:51.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64772024-11-27T18:39:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64782024-11-27T18:39:51.409ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
64792024-11-27T18:39:51.409ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.780183ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
64802024-11-27T18:39:51.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.475277ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64812024-11-27T18:39:52.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e1a60cbe-4228-41cb-9c9e-150ba8e840d5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64822024-11-27T18:39:52.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e1a60cbe-4228-41cb-9c9e-150ba8e840d5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64832024-11-27T18:39:52.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e1a60cbe-4228-41cb-9c9e-150ba8e840d5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64842024-11-27T18:39:53.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d55b941c-ed32-4af1-b66a-494d29ec3085 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64852024-11-27T18:39:53.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d55b941c-ed32-4af1-b66a-494d29ec3085 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64862024-11-27T18:39:53.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d55b941c-ed32-4af1-b66a-494d29ec3085 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64872024-11-27T18:39:53.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ba634a4c-7690-4f56-afbe-f0d4dfe4136e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
64882024-11-27T18:39:54.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ed46828-04c2-446a-a800-e5c3816edfb0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64892024-11-27T18:39:54.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ed46828-04c2-446a-a800-e5c3816edfb0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64902024-11-27T18:39:54.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1ed46828-04c2-446a-a800-e5c3816edfb0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64912024-11-27T18:39:55.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7e002200-279d-45c7-843b-6b9a698c571d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64922024-11-27T18:39:55.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7e002200-279d-45c7-843b-6b9a698c571d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64932024-11-27T18:39:55.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7e002200-279d-45c7-843b-6b9a698c571d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64942024-11-27T18:39:56.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13461171-cab3-41b4-aa94-5d3471cc16ee roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64952024-11-27T18:39:56.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13461171-cab3-41b4-aa94-5d3471cc16ee resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64962024-11-27T18:39:56.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13461171-cab3-41b4-aa94-5d3471cc16ee response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64972024-11-27T18:39:57.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93bdc9ef-5d5d-485b-a488-fde335631581 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64982024-11-27T18:39:57.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93bdc9ef-5d5d-485b-a488-fde335631581 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
64992024-11-27T18:39:57.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93bdc9ef-5d5d-485b-a488-fde335631581 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65002024-11-27T18:39:58.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5d401d4d-41d5-4219-ad74-46a08776f037 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65012024-11-27T18:39:58.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5d401d4d-41d5-4219-ad74-46a08776f037 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65022024-11-27T18:39:58.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5d401d4d-41d5-4219-ad74-46a08776f037 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65032024-11-27T18:39:59.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b5b2bf7-1d44-4229-a861-fabaaa915547 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65042024-11-27T18:39:59.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b5b2bf7-1d44-4229-a861-fabaaa915547 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65052024-11-27T18:39:59.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b5b2bf7-1d44-4229-a861-fabaaa915547 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65062024-11-27T18:40:00.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07d9d992-ba13-441f-8c46-99bb35c867c3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65072024-11-27T18:40:00.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07d9d992-ba13-441f-8c46-99bb35c867c3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65082024-11-27T18:40:00.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 07d9d992-ba13-441f-8c46-99bb35c867c3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65092024-11-27T18:40:01.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49dcba21-58d7-4c6f-a44a-80bf683c289a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65102024-11-27T18:40:01.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49dcba21-58d7-4c6f-a44a-80bf683c289a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65112024-11-27T18:40:01.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 49dcba21-58d7-4c6f-a44a-80bf683c289a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
65122024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
65132024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
65142024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65152024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65162024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
65172024-11-27T18:40:01.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65182024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
65192024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65202024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65212024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
65222024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65232024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
65242024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
65252024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65262024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65272024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65282024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
65292024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65302024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
65312024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
65322024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65332024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
65342024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
65352024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
65362024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65372024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65382024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65392024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
65402024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65412024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65422024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65432024-11-27T18:40:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65442024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65452024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65462024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65472024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65482024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65492024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65502024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65512024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65522024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65532024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
65552024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
65562024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65572024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65582024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
65592024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65602024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65612024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65622024-11-27T18:40:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65632024-11-27T18:40:01.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65642024-11-27T18:40:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.890648ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65652024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65662024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65672024-11-27T18:40:01.396ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65682024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65692024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65702024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65712024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65722024-11-27T18:40:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65732024-11-27T18:40:01.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65742024-11-27T18:40:01.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65752024-11-27T18:40:01.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65762024-11-27T18:40:01.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65772024-11-27T18:40:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65782024-11-27T18:40:01.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.736164ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
65792024-11-27T18:40:01.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 397022494 } })
65802024-11-27T18:40:01.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65812024-11-27T18:40:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65822024-11-27T18:40:01.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65832024-11-27T18:40:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65842024-11-27T18:40:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65852024-11-27T18:40:01.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65862024-11-27T18:40:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65872024-11-27T18:40:01.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65882024-11-27T18:40:01.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 400834990 } })
65892024-11-27T18:40:01.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65902024-11-27T18:40:01.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 401996477 } })
65912024-11-27T18:40:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65922024-11-27T18:40:01.404ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65932024-11-27T18:40:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65942024-11-27T18:40:01.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
65952024-11-27T18:40:01.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65962024-11-27T18:40:01.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65972024-11-27T18:40:01.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65982024-11-27T18:40:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65992024-11-27T18:40:01.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66002024-11-27T18:40:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66012024-11-27T18:40:01.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66022024-11-27T18:40:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66032024-11-27T18:40:01.426ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66042024-11-27T18:40:01.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66052024-11-27T18:40:01.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66062024-11-27T18:40:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66072024-11-27T18:40:01.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.417254ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
66082024-11-27T18:40:01.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66092024-11-27T18:40:01.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66102024-11-27T18:40:01.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66112024-11-27T18:40:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66122024-11-27T18:40:01.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66132024-11-27T18:40:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66142024-11-27T18:40:01.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66152024-11-27T18:40:01.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66162024-11-27T18:40:01.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66182024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66192024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66202024-11-27T18:40:01.438ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66212024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66222024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66232024-11-27T18:40:01.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66242024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66252024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66262024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66272024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66282024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66292024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
66302024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66312024-11-27T18:40:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66322024-11-27T18:40:01.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66332024-11-27T18:40:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66342024-11-27T18:40:01.441ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.226924ms iteration = 12 status = 0
66352024-11-27T18:40:01.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-11-27T18:40:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
66372024-11-27T18:40:01.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66382024-11-27T18:40:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66392024-11-27T18:40:01.445ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66402024-11-27T18:40:01.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.086767ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66412024-11-27T18:40:01.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66422024-11-27T18:40:01.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66432024-11-27T18:40:01.467ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
66442024-11-27T18:40:01.467ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.742343ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
66452024-11-27T18:40:01.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.725457ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66462024-11-27T18:40:01.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66472024-11-27T18:40:01.474ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66482024-11-27T18:40:01.474ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2641d615-3ebc-4e09-81ad-2d75f5a4b3b0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66492024-11-27T18:40:01.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66502024-11-27T18:40:01.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.721626ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66512024-11-27T18:40:01.476ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66522024-11-27T18:40:01.479ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66532024-11-27T18:40:01.479ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66542024-11-27T18:40:01.479ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.278558ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66552024-11-27T18:40:01.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.243647ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66562024-11-27T18:40:01.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66572024-11-27T18:40:01.490ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66582024-11-27T18:40:01.491ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ffec09c-17df-46eb-aa40-447106e6d78d", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66592024-11-27T18:40:01.491ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66602024-11-27T18:40:01.492ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66612024-11-27T18:40:01.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.534545ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66622024-11-27T18:40:01.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
66632024-11-27T18:40:01.497ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66642024-11-27T18:40:01.497ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f77c6588-34f0-41ff-b13a-b178ebd9290d", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66652024-11-27T18:40:01.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66662024-11-27T18:40:01.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
66672024-11-27T18:40:01.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66682024-11-27T18:40:01.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66692024-11-27T18:40:01.516ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.378808ms iteration = 14 status = {"physical_disks_added":0}
66702024-11-27T18:40:01.587ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.734622ms iteration = 12 status = {}
66712024-11-27T18:40:01.604ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66722024-11-27T18:40:01.604ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a126393-698f-49d0-b6ec-340c5385a7a0", "content-length": "1", "date": "Wed, 27 Nov 2024 18:40:00 GMT"} })
66732024-11-27T18:40:01.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66742024-11-27T18:40:01.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66752024-11-27T18:40:01.619ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66762024-11-27T18:40:01.619ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66772024-11-27T18:40:01.619ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e6fe4e7-8e1c-43ee-b7c4-6db92735c581", "content-length": "372", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66782024-11-27T18:40:01.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66792024-11-27T18:40:01.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66802024-11-27T18:40:01.622ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.434331ms iteration = 12 status = null
66812024-11-27T18:40:01.679ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
66822024-11-27T18:40:01.679ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66832024-11-27T18:40:01.679ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b5d63b6f-6771-4709-93b8-e22d56250fb7", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66842024-11-27T18:40:01.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66852024-11-27T18:40:01.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66862024-11-27T18:40:01.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66872024-11-27T18:40:01.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66882024-11-27T18:40:01.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66892024-11-27T18:40:01.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66902024-11-27T18:40:01.690ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66912024-11-27T18:40:01.690ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66922024-11-27T18:40:01.690ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c1cb515-7595-41f3-8043-d4562a690417", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
66932024-11-27T18:40:01.692ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.804418ms iteration = 12 status = {}
66942024-11-27T18:40:01.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66952024-11-27T18:40:01.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66962024-11-27T18:40:01.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
66972024-11-27T18:40:01.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66982024-11-27T18:40:01.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66992024-11-27T18:40:01.712ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67002024-11-27T18:40:01.713ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfbe26a0-1e88-4b4c-8620-026c4ea69538", "content-length": "134", "date": "Wed, 27 Nov 2024 18:40:00 GMT"} })
67012024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67022024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
67032024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67042024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67052024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67062024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67072024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67082024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67092024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67102024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67112024-11-27T18:40:01.713ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
67122024-11-27T18:40:01.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67132024-11-27T18:40:01.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67142024-11-27T18:40:01.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67152024-11-27T18:40:01.716ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f27a79e9-16cf-47ac-a027-2e87ff64951a", "content-length": "2", "date": "Wed, 27 Nov 2024 18:40:00 GMT"} })
67162024-11-27T18:40:01.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67172024-11-27T18:40:01.716ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd012d17-7bd1-40b3-8877-1f6076dff4d2", "content-length": "52", "date": "Wed, 27 Nov 2024 18:40:00 GMT"} })
67182024-11-27T18:40:01.716ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
67192024-11-27T18:40:01.716ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67202024-11-27T18:40:01.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67212024-11-27T18:40:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67222024-11-27T18:40:01.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232024-11-27T18:40:01.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67242024-11-27T18:40:01.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67252024-11-27T18:40:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67262024-11-27T18:40:01.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67272024-11-27T18:40:01.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67282024-11-27T18:40:01.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67292024-11-27T18:40:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67302024-11-27T18:40:01.779ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67312024-11-27T18:40:01.814ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "886ede9d-6422-4778-9a12-3a1987ce3f40", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
67322024-11-27T18:40:01.814ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
67332024-11-27T18:40:01.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67342024-11-27T18:40:01.815ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bffc4cd4-5970-4548-b35c-2c201ecbca77", "content-length": "682", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
67352024-11-27T18:40:01.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67362024-11-27T18:40:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67372024-11-27T18:40:01.815ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "490c7618-f4c4-4a67-988c-13cef16e2f3c", "content-length": "691", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
67382024-11-27T18:40:01.815ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67392024-11-27T18:40:01.815ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67402024-11-27T18:40:01.815ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67412024-11-27T18:40:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.695659ms iteration = 12 status = {}
67422024-11-27T18:40:01.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67432024-11-27T18:40:01.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67442024-11-27T18:40:01.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67452024-11-27T18:40:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67462024-11-27T18:40:01.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67472024-11-27T18:40:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67482024-11-27T18:40:01.835ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.59009ms iteration = 12 status = {}
67492024-11-27T18:40:02.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc821bcb-2603-4cae-8d2b-7b006e16e34d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67502024-11-27T18:40:02.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc821bcb-2603-4cae-8d2b-7b006e16e34d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67512024-11-27T18:40:02.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc821bcb-2603-4cae-8d2b-7b006e16e34d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67522024-11-27T18:40:02.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ffe8eb9-3392-4279-b042-aa15c9eabec1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
67532024-11-27T18:40:02.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ffe8eb9-3392-4279-b042-aa15c9eabec1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
67542024-11-27T18:40:02.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 3ffe8eb9-3392-4279-b042-aa15c9eabec1 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
67552024-11-27T18:40:03.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 85de7cef-637f-499f-a98b-63053a15b47c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67562024-11-27T18:40:03.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 85de7cef-637f-499f-a98b-63053a15b47c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67572024-11-27T18:40:03.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 85de7cef-637f-499f-a98b-63053a15b47c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67582024-11-27T18:40:03.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = df334e1d-fc3f-4416-8265-daba413fdbed response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
67592024-11-27T18:40:04.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfa429ff-3c53-4068-9531-da80a298326d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67602024-11-27T18:40:04.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfa429ff-3c53-4068-9531-da80a298326d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67612024-11-27T18:40:04.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfa429ff-3c53-4068-9531-da80a298326d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67622024-11-27T18:40:05.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d0bdedb3-343e-400e-b5d1-d238105339fd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67632024-11-27T18:40:05.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d0bdedb3-343e-400e-b5d1-d238105339fd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67642024-11-27T18:40:05.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d0bdedb3-343e-400e-b5d1-d238105339fd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67652024-11-27T18:40:06.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6500efe7-8bbc-4304-bd97-6313613ca8de roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67662024-11-27T18:40:06.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6500efe7-8bbc-4304-bd97-6313613ca8de resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67672024-11-27T18:40:06.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6500efe7-8bbc-4304-bd97-6313613ca8de response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67682024-11-27T18:40:07.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6921c0c8-2801-4c24-8759-53480572f1f7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67692024-11-27T18:40:07.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6921c0c8-2801-4c24-8759-53480572f1f7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67702024-11-27T18:40:07.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6921c0c8-2801-4c24-8759-53480572f1f7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67712024-11-27T18:40:08.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca142577-3d5b-4a16-94f6-30de9e5ebdf0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67722024-11-27T18:40:08.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca142577-3d5b-4a16-94f6-30de9e5ebdf0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67732024-11-27T18:40:08.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ca142577-3d5b-4a16-94f6-30de9e5ebdf0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67742024-11-27T18:40:09.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b75184f1-869e-43ce-9b4d-cf0b87974f88 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67752024-11-27T18:40:09.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b75184f1-869e-43ce-9b4d-cf0b87974f88 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67762024-11-27T18:40:09.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b75184f1-869e-43ce-9b4d-cf0b87974f88 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67772024-11-27T18:40:10.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ec44dca-2242-4f79-ae1b-6169393dab99 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67782024-11-27T18:40:10.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ec44dca-2242-4f79-ae1b-6169393dab99 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67792024-11-27T18:40:10.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8ec44dca-2242-4f79-ae1b-6169393dab99 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
67802024-11-27T18:40:11.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
67812024-11-27T18:40:11.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67822024-11-27T18:40:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67832024-11-27T18:40:11.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
67842024-11-27T18:40:11.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67852024-11-27T18:40:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-11-27T18:40:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67872024-11-27T18:40:11.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67882024-11-27T18:40:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67892024-11-27T18:40:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67902024-11-27T18:40:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67912024-11-27T18:40:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67922024-11-27T18:40:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.432311ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67932024-11-27T18:40:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67942024-11-27T18:40:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67952024-11-27T18:40:11.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67962024-11-27T18:40:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
67972024-11-27T18:40:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67982024-11-27T18:40:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67992024-11-27T18:40:11.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
68002024-11-27T18:40:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.037121ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
68012024-11-27T18:40:11.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c131a32a-28ba-4c90-9288-cae31087be76 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68022024-11-27T18:40:11.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c131a32a-28ba-4c90-9288-cae31087be76 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68032024-11-27T18:40:11.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c131a32a-28ba-4c90-9288-cae31087be76 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68042024-11-27T18:40:12.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6ecfb43-b9a4-4210-b6ee-522c7a808093 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68052024-11-27T18:40:12.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6ecfb43-b9a4-4210-b6ee-522c7a808093 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68062024-11-27T18:40:12.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6ecfb43-b9a4-4210-b6ee-522c7a808093 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68072024-11-27T18:40:13.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 664 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 6d7be764-3ec5-4616-b16d-757deeb589f5 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
68082024-11-27T18:40:13.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77acee42-88cc-4f52-8d84-13b3741edcd9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68092024-11-27T18:40:13.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77acee42-88cc-4f52-8d84-13b3741edcd9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68102024-11-27T18:40:13.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77acee42-88cc-4f52-8d84-13b3741edcd9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68112024-11-27T18:40:14.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65b1e397-82db-4fca-b4dd-e5871290a59f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68122024-11-27T18:40:14.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65b1e397-82db-4fca-b4dd-e5871290a59f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68132024-11-27T18:40:14.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65b1e397-82db-4fca-b4dd-e5871290a59f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68142024-11-27T18:40:15.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 116db7c6-4b98-492a-96ff-3011f505bd75 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68152024-11-27T18:40:15.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 116db7c6-4b98-492a-96ff-3011f505bd75 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68162024-11-27T18:40:15.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 116db7c6-4b98-492a-96ff-3011f505bd75 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68172024-11-27T18:40:16.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e5ab51-2a34-4d7d-bf42-b2351492e74f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68182024-11-27T18:40:16.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e5ab51-2a34-4d7d-bf42-b2351492e74f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68192024-11-27T18:40:16.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f3e5ab51-2a34-4d7d-bf42-b2351492e74f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68202024-11-27T18:40:17.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c5d53822-2aeb-4133-b880-83b55551e7a8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68212024-11-27T18:40:17.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c5d53822-2aeb-4133-b880-83b55551e7a8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68222024-11-27T18:40:17.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c5d53822-2aeb-4133-b880-83b55551e7a8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68232024-11-27T18:40:18.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8dbc3cf2-2bc7-4437-aee5-008780bf7c67 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68242024-11-27T18:40:18.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8dbc3cf2-2bc7-4437-aee5-008780bf7c67 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68252024-11-27T18:40:18.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8dbc3cf2-2bc7-4437-aee5-008780bf7c67 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68262024-11-27T18:40:19.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6cfd0a70-23f4-424e-b3af-a585128269fb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68272024-11-27T18:40:19.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6cfd0a70-23f4-424e-b3af-a585128269fb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68282024-11-27T18:40:19.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6cfd0a70-23f4-424e-b3af-a585128269fb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68292024-11-27T18:40:20.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80878486-962d-4344-be1e-394c714c0bab roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68302024-11-27T18:40:20.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80878486-962d-4344-be1e-394c714c0bab resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68312024-11-27T18:40:20.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80878486-962d-4344-be1e-394c714c0bab response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68322024-11-27T18:40:21.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
68332024-11-27T18:40:21.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68342024-11-27T18:40:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68352024-11-27T18:40:21.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
68362024-11-27T18:40:21.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68372024-11-27T18:40:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68382024-11-27T18:40:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392024-11-27T18:40:21.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68402024-11-27T18:40:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68412024-11-27T18:40:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68422024-11-27T18:40:21.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68432024-11-27T18:40:21.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.99722ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68442024-11-27T18:40:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68452024-11-27T18:40:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68462024-11-27T18:40:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68472024-11-27T18:40:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68482024-11-27T18:40:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
68492024-11-27T18:40:21.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68502024-11-27T18:40:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68512024-11-27T18:40:21.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
68522024-11-27T18:40:21.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.690051ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
68532024-11-27T18:40:21.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b6532a9-79a2-4c54-8b0e-9592e43de539 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68542024-11-27T18:40:21.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b6532a9-79a2-4c54-8b0e-9592e43de539 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68552024-11-27T18:40:21.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b6532a9-79a2-4c54-8b0e-9592e43de539 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68562024-11-27T18:40:22.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93117db1-8cb1-40ce-8f32-50586a7c313b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68572024-11-27T18:40:22.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93117db1-8cb1-40ce-8f32-50586a7c313b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68582024-11-27T18:40:22.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93117db1-8cb1-40ce-8f32-50586a7c313b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68592024-11-27T18:40:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = cf10a719-9d7b-4acd-b5b4-8193aea16678 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
68602024-11-27T18:40:23.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03fba2e5-bfb5-4a89-b958-4004caae26fd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68612024-11-27T18:40:23.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03fba2e5-bfb5-4a89-b958-4004caae26fd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68622024-11-27T18:40:23.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03fba2e5-bfb5-4a89-b958-4004caae26fd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68632024-11-27T18:40:24.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 590129ea-3f32-427c-9d11-bc640591bf81 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68642024-11-27T18:40:24.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 590129ea-3f32-427c-9d11-bc640591bf81 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68652024-11-27T18:40:24.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 590129ea-3f32-427c-9d11-bc640591bf81 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68662024-11-27T18:40:25.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44dac3b0-8586-4024-bda1-42ab4a88c6e9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68672024-11-27T18:40:25.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44dac3b0-8586-4024-bda1-42ab4a88c6e9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68682024-11-27T18:40:25.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44dac3b0-8586-4024-bda1-42ab4a88c6e9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68692024-11-27T18:40:26.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7ed036d-0bb8-45e1-85f9-b34a474a17c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68702024-11-27T18:40:26.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7ed036d-0bb8-45e1-85f9-b34a474a17c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68712024-11-27T18:40:26.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7ed036d-0bb8-45e1-85f9-b34a474a17c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68722024-11-27T18:40:27.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1f24c6-a888-4f00-b417-704a4d564cb3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68732024-11-27T18:40:27.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1f24c6-a888-4f00-b417-704a4d564cb3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68742024-11-27T18:40:27.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1f24c6-a888-4f00-b417-704a4d564cb3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68752024-11-27T18:40:28.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ae95eaad-de5f-46c3-80ae-66f7a6bd2cf4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68762024-11-27T18:40:28.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ae95eaad-de5f-46c3-80ae-66f7a6bd2cf4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68772024-11-27T18:40:28.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ae95eaad-de5f-46c3-80ae-66f7a6bd2cf4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68782024-11-27T18:40:30.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13061c19-149a-423c-b27a-f3a3a0b215a4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68792024-11-27T18:40:30.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13061c19-149a-423c-b27a-f3a3a0b215a4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68802024-11-27T18:40:30.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13061c19-149a-423c-b27a-f3a3a0b215a4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68812024-11-27T18:40:31.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e72a15-d447-47f2-8eb3-1cda5f092577 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68822024-11-27T18:40:31.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e72a15-d447-47f2-8eb3-1cda5f092577 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68832024-11-27T18:40:31.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 06e72a15-d447-47f2-8eb3-1cda5f092577 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
68842024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
68852024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
68862024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68872024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
68882024-11-27T18:40:31.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
68892024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68902024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.19\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
68912024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
68922024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
68932024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68942024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
68952024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68962024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
68972024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68982024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
68992024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
69002024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69012024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
69022024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69032024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
69042024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69052024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
69062024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69072024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
69082024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69092024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69102024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
69112024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69122024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
69132024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69142024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69152024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
69162024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
69172024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69182024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
69192024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69202024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69212024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
69222024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69232024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
69242024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
69252024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69262024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
69272024-11-27T18:40:31.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69282024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
69292024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69302024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69312024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
69322024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
69332024-11-27T18:40:31.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69342024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
69352024-11-27T18:40:31.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:30:31.392440284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69362024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69372024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69382024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69392024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69402024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
69412024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
69422024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69432024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69442024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69452024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69462024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
69472024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69482024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
69492024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69502024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69512024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69522024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69532024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69542024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69552024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69562024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69572024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69582024-11-27T18:40:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 389872688 } })
69592024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69602024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69612024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69622024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69632024-11-27T18:40:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69642024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69652024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69662024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69672024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69682024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69692024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69702024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69712024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69722024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69732024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69742024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69752024-11-27T18:40:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 390108821 } })
69762024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69772024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69782024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69792024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.034676ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69802024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69812024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69822024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
69832024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.126287ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
69842024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69852024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69862024-11-27T18:40:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69872024-11-27T18:40:31.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69882024-11-27T18:40:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.553663ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
69892024-11-27T18:40:31.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69902024-11-27T18:40:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.917178ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
69912024-11-27T18:40:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.00208ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69922024-11-27T18:40:31.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 393859847 } })
69932024-11-27T18:40:31.397ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69942024-11-27T18:40:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69952024-11-27T18:40:31.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69962024-11-27T18:40:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69972024-11-27T18:40:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69982024-11-27T18:40:31.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69992024-11-27T18:40:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70002024-11-27T18:40:31.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70012024-11-27T18:40:31.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70022024-11-27T18:40:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70032024-11-27T18:40:31.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70042024-11-27T18:40:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70052024-11-27T18:40:31.401ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70062024-11-27T18:40:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70072024-11-27T18:40:31.402ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70082024-11-27T18:40:31.402ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70092024-11-27T18:40:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.11244ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70102024-11-27T18:40:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70112024-11-27T18:40:31.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70122024-11-27T18:40:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70132024-11-27T18:40:31.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70142024-11-27T18:40:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70152024-11-27T18:40:31.406ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70162024-11-27T18:40:31.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70172024-11-27T18:40:31.407ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70182024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70192024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70202024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70212024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70222024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70232024-11-27T18:40:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70242024-11-27T18:40:31.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70252024-11-27T18:40:31.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70262024-11-27T18:40:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70272024-11-27T18:40:31.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 408909660 } })
70282024-11-27T18:40:31.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70292024-11-27T18:40:31.412ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70302024-11-27T18:40:31.414ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70312024-11-27T18:40:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70322024-11-27T18:40:31.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70332024-11-27T18:40:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70342024-11-27T18:40:31.416ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:30:31.392440284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70352024-11-27T18:40:31.416ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.64994ms iteration = 7 status = {"expiration":"2024-11-27T18:30:31.392440284Z","pruned":[]}
70362024-11-27T18:40:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70372024-11-27T18:40:31.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70382024-11-27T18:40:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70392024-11-27T18:40:31.417ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70402024-11-27T18:40:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70412024-11-27T18:40:31.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70422024-11-27T18:40:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70432024-11-27T18:40:31.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442024-11-27T18:40:31.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70452024-11-27T18:40:31.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70462024-11-27T18:40:31.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70472024-11-27T18:40:31.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70482024-11-27T18:40:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70492024-11-27T18:40:31.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70502024-11-27T18:40:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70512024-11-27T18:40:31.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522024-11-27T18:40:31.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70532024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70542024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70552024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70562024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70572024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70582024-11-27T18:40:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70592024-11-27T18:40:31.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70602024-11-27T18:40:31.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70612024-11-27T18:40:31.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622024-11-27T18:40:31.429ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70632024-11-27T18:40:31.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70642024-11-27T18:40:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70652024-11-27T18:40:31.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70662024-11-27T18:40:31.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70672024-11-27T18:40:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70682024-11-27T18:40:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70692024-11-27T18:40:31.433ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 40.835455ms iteration = 4 status = {"nsuccess":5}
70702024-11-27T18:40:31.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712024-11-27T18:40:31.434ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70722024-11-27T18:40:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70732024-11-27T18:40:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
70742024-11-27T18:40:31.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70752024-11-27T18:40:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70762024-11-27T18:40:31.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.226646ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
70772024-11-27T18:40:31.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782024-11-27T18:40:31.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.453434ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70792024-11-27T18:40:31.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70802024-11-27T18:40:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70812024-11-27T18:40:31.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70822024-11-27T18:40:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70832024-11-27T18:40:31.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70842024-11-27T18:40:31.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70852024-11-27T18:40:31.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70862024-11-27T18:40:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70872024-11-27T18:40:31.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70882024-11-27T18:40:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70892024-11-27T18:40:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70902024-11-27T18:40:31.444ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70912024-11-27T18:40:31.444ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70922024-11-27T18:40:31.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70932024-11-27T18:40:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70942024-11-27T18:40:31.444ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70952024-11-27T18:40:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70962024-11-27T18:40:31.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70972024-11-27T18:40:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70982024-11-27T18:40:31.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
70992024-11-27T18:40:31.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.961335ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
71002024-11-27T18:40:31.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71012024-11-27T18:40:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71022024-11-27T18:40:31.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71032024-11-27T18:40:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71042024-11-27T18:40:31.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71052024-11-27T18:40:31.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71062024-11-27T18:40:31.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71072024-11-27T18:40:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71082024-11-27T18:40:31.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 449619053 } })
71092024-11-27T18:40:31.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
71102024-11-27T18:40:31.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.885721ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71112024-11-27T18:40:31.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71122024-11-27T18:40:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71132024-11-27T18:40:31.461ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71142024-11-27T18:40:31.461ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71152024-11-27T18:40:31.461ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71162024-11-27T18:40:31.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71172024-11-27T18:40:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71182024-11-27T18:40:31.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71192024-11-27T18:40:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71202024-11-27T18:40:31.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212024-11-27T18:40:31.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71222024-11-27T18:40:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71232024-11-27T18:40:31.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71242024-11-27T18:40:31.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71252024-11-27T18:40:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
71262024-11-27T18:40:31.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71272024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71282024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.225959ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71292024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71302024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71312024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71322024-11-27T18:40:31.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71332024-11-27T18:40:31.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71342024-11-27T18:40:31.473ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71352024-11-27T18:40:31.473ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.116482ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71362024-11-27T18:40:31.474ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.459343ms iteration = 13 status = 0
71372024-11-27T18:40:31.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382024-11-27T18:40:31.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.33134ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71392024-11-27T18:40:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71402024-11-27T18:40:31.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71412024-11-27T18:40:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71422024-11-27T18:40:31.483ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71432024-11-27T18:40:31.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71442024-11-27T18:40:31.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71452024-11-27T18:40:31.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
71462024-11-27T18:40:31.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71472024-11-27T18:40:31.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482024-11-27T18:40:31.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71492024-11-27T18:40:31.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71502024-11-27T18:40:31.486ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71512024-11-27T18:40:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71522024-11-27T18:40:31.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532024-11-27T18:40:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71542024-11-27T18:40:31.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71552024-11-27T18:40:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71562024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71572024-11-27T18:40:31.491ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71582024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.971327ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71592024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
71602024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71612024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
71622024-11-27T18:40:31.491ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 99.312022ms iteration = 7 status = {"generation":2}
71632024-11-27T18:40:31.495ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71642024-11-27T18:40:31.495ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71652024-11-27T18:40:31.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.046168ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71662024-11-27T18:40:31.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71672024-11-27T18:40:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71682024-11-27T18:40:31.501ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71692024-11-27T18:40:31.503ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71702024-11-27T18:40:31.503ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71712024-11-27T18:40:31.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71722024-11-27T18:40:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71732024-11-27T18:40:31.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71742024-11-27T18:40:31.507ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71752024-11-27T18:40:31.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71762024-11-27T18:40:31.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71772024-11-27T18:40:31.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71782024-11-27T18:40:31.510ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71792024-11-27T18:40:31.510ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71802024-11-27T18:40:31.510ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
71812024-11-27T18:40:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 118.617538ms iteration = 7 status = {"generation":1}
71822024-11-27T18:40:31.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71832024-11-27T18:40:31.522ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71842024-11-27T18:40:31.522ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab381c3-1207-43ca-920e-750138e99ad0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
71852024-11-27T18:40:31.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71862024-11-27T18:40:31.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71872024-11-27T18:40:31.543ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.365083ms iteration = 15 status = {"physical_disks_added":0}
71882024-11-27T18:40:31.545ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
71892024-11-27T18:40:31.545ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 152.670783ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71902024-11-27T18:40:31.559ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71912024-11-27T18:40:31.559ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 167.296769ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71922024-11-27T18:40:31.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71932024-11-27T18:40:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71942024-11-27T18:40:31.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-11-27T18:40:31.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71962024-11-27T18:40:31.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71972024-11-27T18:40:31.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71982024-11-27T18:40:31.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71992024-11-27T18:40:31.662ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72002024-11-27T18:40:31.662ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5246f13d-e6b1-4238-97f6-b4f4f6447133", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72012024-11-27T18:40:31.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72022024-11-27T18:40:31.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72032024-11-27T18:40:31.693ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72042024-11-27T18:40:31.694ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "46861427-dd12-40ea-aa3a-122a0684e37f", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72052024-11-27T18:40:31.694ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72062024-11-27T18:40:31.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "55315bb0-45eb-4ce7-a4b3-01b964d85b07", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72072024-11-27T18:40:31.696ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72082024-11-27T18:40:31.696ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72092024-11-27T18:40:31.696ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72102024-11-27T18:40:31.697ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c34c7e-786f-4aaa-b174-4ca71297700b", "content-length": "372", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72112024-11-27T18:40:31.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72122024-11-27T18:40:31.697ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72132024-11-27T18:40:31.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.509018ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72142024-11-27T18:40:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72152024-11-27T18:40:31.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-11-27T18:40:31.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72172024-11-27T18:40:31.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72182024-11-27T18:40:31.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72192024-11-27T18:40:31.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
72202024-11-27T18:40:31.710ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72212024-11-27T18:40:31.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "583f4494-3819-48b7-bca2-3b02a5fdfb7b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72222024-11-27T18:40:31.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72232024-11-27T18:40:31.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
72242024-11-27T18:40:31.724ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72252024-11-27T18:40:31.724ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72262024-11-27T18:40:31.724ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "39d07e30-7282-42a3-86b9-e98ad09b76b7", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72272024-11-27T18:40:31.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72282024-11-27T18:40:31.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72292024-11-27T18:40:31.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72302024-11-27T18:40:31.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72312024-11-27T18:40:31.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72322024-11-27T18:40:31.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72332024-11-27T18:40:31.735ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72342024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72352024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2223ebb9-c538-4422-a446-2cae0dd976a5", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72362024-11-27T18:40:31.736ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.586238ms iteration = 13 status = {}
72372024-11-27T18:40:31.793ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72382024-11-27T18:40:31.816ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72392024-11-27T18:40:31.816ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ffec0a5-1848-47fb-95ae-5fdba457c2e3", "content-length": "1", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72402024-11-27T18:40:31.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72412024-11-27T18:40:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72422024-11-27T18:40:31.820ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 428.332248ms iteration = 13 status = null
72432024-11-27T18:40:31.840ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72442024-11-27T18:40:31.841ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "26cadc91-8938-4121-8907-df100b31ec14", "content-length": "691", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72452024-11-27T18:40:31.841ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72462024-11-27T18:40:31.841ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72472024-11-27T18:40:31.841ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72482024-11-27T18:40:31.842ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 450.499597ms iteration = 13 status = {}
72492024-11-27T18:40:31.855ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.479389ms iteration = 13 status = {}
72502024-11-27T18:40:31.890ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72512024-11-27T18:40:31.890ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "aea86929-ba6e-445f-b7ad-378fdeff6ecc", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72522024-11-27T18:40:31.890ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72532024-11-27T18:40:31.892ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6cf5c257-44ac-4221-9c40-8954d83a2223", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72542024-11-27T18:40:31.892ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72552024-11-27T18:40:31.894ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "699645cc-b026-4e56-b55e-8410ec55700d", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72562024-11-27T18:40:31.894ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72572024-11-27T18:40:31.896ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72582024-11-27T18:40:31.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 504.253504ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72592024-11-27T18:40:31.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72602024-11-27T18:40:31.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72612024-11-27T18:40:31.923ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
72622024-11-27T18:40:31.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72632024-11-27T18:40:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72642024-11-27T18:40:31.932ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72652024-11-27T18:40:31.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee22dc8d-74b8-4516-ac41-8be69fbd2f78", "content-length": "134", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72662024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72672024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
72682024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72692024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72702024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72712024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72722024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72732024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72742024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72752024-11-27T18:40:31.933ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72762024-11-27T18:40:31.934ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
72772024-11-27T18:40:31.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72782024-11-27T18:40:31.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72792024-11-27T18:40:31.936ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72802024-11-27T18:40:31.936ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6123e894-a38c-4a09-94da-9453b8157189", "content-length": "2", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72812024-11-27T18:40:31.936ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72822024-11-27T18:40:31.936ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "af41ad43-9f43-4624-9a0d-d56004d4fd17", "content-length": "52", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72832024-11-27T18:40:31.936ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
72842024-11-27T18:40:31.936ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72852024-11-27T18:40:31.984ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72862024-11-27T18:40:31.984ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
72872024-11-27T18:40:32.053ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
72882024-11-27T18:40:32.053ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60604
72892024-11-27T18:40:32.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60604 req_id = 50a81caa-bf15-4b20-8753-0594cfe7bb92 roles = RoleSet { roles: {} } uri = /metrics/producers
72902024-11-27T18:40:32.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60604 req_id = 50a81caa-bf15-4b20-8753-0594cfe7bb92 resource = Database result = Ok(()) uri = /metrics/producers
72912024-11-27T18:40:32.074ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "003967c6-44b5-4008-a7f8-66a7a2a40ee5", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
72922024-11-27T18:40:32.074ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
72932024-11-27T18:40:32.074ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72942024-11-27T18:40:32.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9890fb6c-b1b0-44a2-bf3a-f493dcf96364 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
72952024-11-27T18:40:32.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9890fb6c-b1b0-44a2-bf3a-f493dcf96364 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
72962024-11-27T18:40:32.075ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17cc598d-7d18-4eb3-9704-771ec3d9569d", "content-length": "682", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
72972024-11-27T18:40:32.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72982024-11-27T18:40:32.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72992024-11-27T18:40:32.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9890fb6c-b1b0-44a2-bf3a-f493dcf96364 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73002024-11-27T18:40:32.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73012024-11-27T18:40:32.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73022024-11-27T18:40:32.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73032024-11-27T18:40:32.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73042024-11-27T18:40:32.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73052024-11-27T18:40:32.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73062024-11-27T18:40:32.096ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 236c7b74-8315-46e3-9a37-90380a675558
73072024-11-27T18:40:32.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42960 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60604 req_id = 50a81caa-bf15-4b20-8753-0594cfe7bb92 response_code = 201 uri = /metrics/producers
73082024-11-27T18:40:32.096ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "50a81caa-bf15-4b20-8753-0594cfe7bb92", "content-length": "41", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
73092024-11-27T18:40:32.096ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.579433ms iteration = 13 status = {}
73102024-11-27T18:40:32.099ZDEBGnexus (producer-registration-task): registered with nexus successfully
73112024-11-27T18:40:32.099ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73122024-11-27T18:40:32.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 588d4f70-38de-4348-ac2b-9f3f5baa3e63 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
73132024-11-27T18:40:32.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 588d4f70-38de-4348-ac2b-9f3f5baa3e63 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
73142024-11-27T18:40:32.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 588d4f70-38de-4348-ac2b-9f3f5baa3e63 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
73152024-11-27T18:40:33.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a1dbb25-02ca-44b3-916c-dbe6724553b8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73162024-11-27T18:40:33.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a1dbb25-02ca-44b3-916c-dbe6724553b8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73172024-11-27T18:40:33.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0a1dbb25-02ca-44b3-916c-dbe6724553b8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73182024-11-27T18:40:33.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 2baa1e69-166a-4d31-8161-1d3b2c2b7b95 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
73192024-11-27T18:40:34.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 11f97182-c0b6-4b49-b443-c9112f73d91d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73202024-11-27T18:40:34.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 11f97182-c0b6-4b49-b443-c9112f73d91d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73212024-11-27T18:40:34.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 11f97182-c0b6-4b49-b443-c9112f73d91d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73222024-11-27T18:40:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e466050f-52ab-4c28-a30b-8422f219e010 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73232024-11-27T18:40:35.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e466050f-52ab-4c28-a30b-8422f219e010 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73242024-11-27T18:40:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e466050f-52ab-4c28-a30b-8422f219e010 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73252024-11-27T18:40:36.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322db522-db81-4fa5-befc-2959af53f269 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73262024-11-27T18:40:36.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322db522-db81-4fa5-befc-2959af53f269 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73272024-11-27T18:40:36.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322db522-db81-4fa5-befc-2959af53f269 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73282024-11-27T18:40:37.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3284a8f2-98a0-4cbf-93fa-5c97d5c75bf0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73292024-11-27T18:40:37.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3284a8f2-98a0-4cbf-93fa-5c97d5c75bf0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73302024-11-27T18:40:37.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3284a8f2-98a0-4cbf-93fa-5c97d5c75bf0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73312024-11-27T18:40:38.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6bda578-ee03-4b03-9469-b434c53e2ac2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73322024-11-27T18:40:38.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6bda578-ee03-4b03-9469-b434c53e2ac2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73332024-11-27T18:40:38.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e6bda578-ee03-4b03-9469-b434c53e2ac2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73342024-11-27T18:40:39.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3c50ba8-0ef4-4175-8939-98498958513a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73352024-11-27T18:40:39.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3c50ba8-0ef4-4175-8939-98498958513a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73362024-11-27T18:40:39.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3c50ba8-0ef4-4175-8939-98498958513a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73372024-11-27T18:40:40.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c24e68ee-3685-477a-9fc5-56c74c07cfd3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73382024-11-27T18:40:40.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c24e68ee-3685-477a-9fc5-56c74c07cfd3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73392024-11-27T18:40:40.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c24e68ee-3685-477a-9fc5-56c74c07cfd3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73402024-11-27T18:40:41.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3400f159-ece0-424b-b9e5-7e17932f7f02 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73412024-11-27T18:40:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3400f159-ece0-424b-b9e5-7e17932f7f02 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73422024-11-27T18:40:41.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3400f159-ece0-424b-b9e5-7e17932f7f02 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73432024-11-27T18:40:41.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
73442024-11-27T18:40:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73452024-11-27T18:40:41.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73462024-11-27T18:40:41.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
73472024-11-27T18:40:41.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73482024-11-27T18:40:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73492024-11-27T18:40:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73502024-11-27T18:40:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73512024-11-27T18:40:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73522024-11-27T18:40:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73532024-11-27T18:40:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73542024-11-27T18:40:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73552024-11-27T18:40:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562024-11-27T18:40:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
73572024-11-27T18:40:41.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73582024-11-27T18:40:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73592024-11-27T18:40:41.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
73602024-11-27T18:40:41.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.830053ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
73612024-11-27T18:40:41.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73622024-11-27T18:40:41.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73632024-11-27T18:40:41.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.749566ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73642024-11-27T18:40:42.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89a3ae73-d810-4b76-94b8-6e5df5fca170 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73652024-11-27T18:40:42.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89a3ae73-d810-4b76-94b8-6e5df5fca170 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73662024-11-27T18:40:42.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 89a3ae73-d810-4b76-94b8-6e5df5fca170 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73672024-11-27T18:40:43.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e0d2f504-8d19-4884-aeb1-4e13cfb6b387 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73682024-11-27T18:40:43.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e0d2f504-8d19-4884-aeb1-4e13cfb6b387 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73692024-11-27T18:40:43.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e0d2f504-8d19-4884-aeb1-4e13cfb6b387 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73702024-11-27T18:40:43.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 632 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 5f27edee-079c-4abe-97cd-b27363889a7d response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
73712024-11-27T18:40:44.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b40c035-ee7a-4aee-b0d7-d309054490a0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73722024-11-27T18:40:44.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b40c035-ee7a-4aee-b0d7-d309054490a0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73732024-11-27T18:40:44.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1b40c035-ee7a-4aee-b0d7-d309054490a0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73742024-11-27T18:40:45.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc9edf5e-dcaa-44c0-8664-8b4f41190e6f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73752024-11-27T18:40:45.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc9edf5e-dcaa-44c0-8664-8b4f41190e6f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73762024-11-27T18:40:45.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc9edf5e-dcaa-44c0-8664-8b4f41190e6f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73772024-11-27T18:40:46.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb2b1d36-a0b1-43a6-9663-f81d44060701 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73782024-11-27T18:40:46.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb2b1d36-a0b1-43a6-9663-f81d44060701 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73792024-11-27T18:40:46.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb2b1d36-a0b1-43a6-9663-f81d44060701 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73802024-11-27T18:40:47.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4658396c-7e7b-40a6-9db1-ee41df7f6b87 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73812024-11-27T18:40:47.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4658396c-7e7b-40a6-9db1-ee41df7f6b87 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73822024-11-27T18:40:47.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4658396c-7e7b-40a6-9db1-ee41df7f6b87 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73832024-11-27T18:40:48.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f761b7fc-0391-4b89-a345-6573538a8fac roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73842024-11-27T18:40:48.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f761b7fc-0391-4b89-a345-6573538a8fac resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73852024-11-27T18:40:48.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f761b7fc-0391-4b89-a345-6573538a8fac response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73862024-11-27T18:40:49.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8b1bbe8-f03e-463b-9b6f-9c4262fc7f2e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73872024-11-27T18:40:49.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8b1bbe8-f03e-463b-9b6f-9c4262fc7f2e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73882024-11-27T18:40:49.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8b1bbe8-f03e-463b-9b6f-9c4262fc7f2e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73892024-11-27T18:40:50.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91b7d265-e520-44d3-92de-b929d4f5233a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73902024-11-27T18:40:50.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91b7d265-e520-44d3-92de-b929d4f5233a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73912024-11-27T18:40:50.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 91b7d265-e520-44d3-92de-b929d4f5233a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
73922024-11-27T18:40:51.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
73932024-11-27T18:40:51.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73942024-11-27T18:40:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73952024-11-27T18:40:51.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
73962024-11-27T18:40:51.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73972024-11-27T18:40:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73982024-11-27T18:40:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73992024-11-27T18:40:51.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74002024-11-27T18:40:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74012024-11-27T18:40:51.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.785267ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74022024-11-27T18:40:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74032024-11-27T18:40:51.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74042024-11-27T18:40:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052024-11-27T18:40:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74062024-11-27T18:40:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74072024-11-27T18:40:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74082024-11-27T18:40:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
74092024-11-27T18:40:51.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74102024-11-27T18:40:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74112024-11-27T18:40:51.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
74122024-11-27T18:40:51.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.9597ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
74132024-11-27T18:40:51.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97c6aee3-c241-474f-96bb-71882074504a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74142024-11-27T18:40:51.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97c6aee3-c241-474f-96bb-71882074504a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74152024-11-27T18:40:51.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97c6aee3-c241-474f-96bb-71882074504a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74162024-11-27T18:40:52.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5fb12c-4b71-4c4c-b1ba-4cc630d39de1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74172024-11-27T18:40:52.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5fb12c-4b71-4c4c-b1ba-4cc630d39de1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74182024-11-27T18:40:52.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d5fb12c-4b71-4c4c-b1ba-4cc630d39de1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74192024-11-27T18:40:53.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6e4c942-201e-4cc6-a253-1e438d16fde6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74202024-11-27T18:40:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6e4c942-201e-4cc6-a253-1e438d16fde6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74212024-11-27T18:40:53.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b6e4c942-201e-4cc6-a253-1e438d16fde6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74222024-11-27T18:40:53.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a1364887-47cf-43c8-a5f9-f8f3d615402e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
74232024-11-27T18:40:54.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57c41244-95b1-46d7-a51b-07e431d786c5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74242024-11-27T18:40:54.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57c41244-95b1-46d7-a51b-07e431d786c5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74252024-11-27T18:40:54.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 57c41244-95b1-46d7-a51b-07e431d786c5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74262024-11-27T18:40:55.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f42aa1a-fab2-4d54-bcb4-ebe165aedb53 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74272024-11-27T18:40:55.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f42aa1a-fab2-4d54-bcb4-ebe165aedb53 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74282024-11-27T18:40:55.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1f42aa1a-fab2-4d54-bcb4-ebe165aedb53 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74292024-11-27T18:40:56.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 15d1709c-30e5-4d29-8626-87456e0d75be roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74302024-11-27T18:40:56.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 15d1709c-30e5-4d29-8626-87456e0d75be resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74312024-11-27T18:40:56.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 15d1709c-30e5-4d29-8626-87456e0d75be response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74322024-11-27T18:40:57.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8146efa-a3f8-4ab4-8caf-79ba582be1b3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74332024-11-27T18:40:57.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8146efa-a3f8-4ab4-8caf-79ba582be1b3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74342024-11-27T18:40:57.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8146efa-a3f8-4ab4-8caf-79ba582be1b3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74352024-11-27T18:40:58.573ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:44085
74362024-11-27T18:40:58.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4ce741c7-e587-4e5f-b81f-8e88d3a2b382 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
74372024-11-27T18:40:58.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4ce741c7-e587-4e5f-b81f-8e88d3a2b382 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
74382024-11-27T18:40:58.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4ce741c7-e587-4e5f-b81f-8e88d3a2b382 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
74392024-11-27T18:40:58.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = ffef0cd9-a7cf-42a6-bc7a-32e8514dae0c roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
74402024-11-27T18:40:58.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = ffef0cd9-a7cf-42a6-bc7a-32e8514dae0c resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
74412024-11-27T18:40:58.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = ffef0cd9-a7cf-42a6-bc7a-32e8514dae0c response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
74422024-11-27T18:40:58.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2e73ecd-a15b-424b-a7b1-b1931df9f798 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74432024-11-27T18:40:58.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2e73ecd-a15b-424b-a7b1-b1931df9f798 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74442024-11-27T18:40:58.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2e73ecd-a15b-424b-a7b1-b1931df9f798 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74452024-11-27T18:40:59.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be7e84bf-698e-4a8a-a32c-5eb2a3633217 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74462024-11-27T18:40:59.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be7e84bf-698e-4a8a-a32c-5eb2a3633217 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74472024-11-27T18:40:59.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = be7e84bf-698e-4a8a-a32c-5eb2a3633217 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74482024-11-27T18:41:00.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81968663-ee60-4c5d-9bca-b1c29944edad roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74492024-11-27T18:41:00.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81968663-ee60-4c5d-9bca-b1c29944edad resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74502024-11-27T18:41:00.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 81968663-ee60-4c5d-9bca-b1c29944edad response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
74512024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
74522024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74532024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
74542024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74552024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
74562024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
74572024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
74582024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74592024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
74602024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74612024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74622024-11-27T18:41:01.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
74632024-11-27T18:41:01.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74642024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
74652024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74662024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74672024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
74682024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74692024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
74702024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74712024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
74722024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74732024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74742024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
74752024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74762024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
74772024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74782024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
74792024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74802024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74812024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74822024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
74832024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
74842024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
74852024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74862024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74872024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74882024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74892024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74902024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74912024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74922024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74932024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74942024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74952024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74962024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74972024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74982024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74992024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75002024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75012024-11-27T18:41:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75022024-11-27T18:41:01.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75032024-11-27T18:41:01.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75042024-11-27T18:41:01.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75052024-11-27T18:41:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.573793ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75062024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75072024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75082024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75092024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75102024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75112024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75122024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75132024-11-27T18:41:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75142024-11-27T18:41:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75152024-11-27T18:41:01.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75162024-11-27T18:41:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75172024-11-27T18:41:01.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75182024-11-27T18:41:01.400ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 397369239 } })
75192024-11-27T18:41:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75202024-11-27T18:41:01.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75212024-11-27T18:41:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75222024-11-27T18:41:01.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75232024-11-27T18:41:01.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75242024-11-27T18:41:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75252024-11-27T18:41:01.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75262024-11-27T18:41:01.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 400465645 } })
75272024-11-27T18:41:01.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75282024-11-27T18:41:01.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75292024-11-27T18:41:01.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75302024-11-27T18:41:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75312024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75322024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75332024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75342024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75352024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75362024-11-27T18:41:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75372024-11-27T18:41:01.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75382024-11-27T18:41:01.412ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 408860409 } })
75392024-11-27T18:41:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75402024-11-27T18:41:01.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
75412024-11-27T18:41:01.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75422024-11-27T18:41:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75432024-11-27T18:41:01.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442024-11-27T18:41:01.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
75452024-11-27T18:41:01.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75462024-11-27T18:41:01.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75472024-11-27T18:41:01.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 34.959809ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
75482024-11-27T18:41:01.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75492024-11-27T18:41:01.431ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
75502024-11-27T18:41:01.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.584827ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
75512024-11-27T18:41:01.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75522024-11-27T18:41:01.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75532024-11-27T18:41:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75542024-11-27T18:41:01.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75552024-11-27T18:41:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75562024-11-27T18:41:01.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-11-27T18:41:01.437ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75582024-11-27T18:41:01.437ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75592024-11-27T18:41:01.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75602024-11-27T18:41:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75612024-11-27T18:41:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
75622024-11-27T18:41:01.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75632024-11-27T18:41:01.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75642024-11-27T18:41:01.440ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75652024-11-27T18:41:01.440ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75662024-11-27T18:41:01.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75672024-11-27T18:41:01.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.783708ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75682024-11-27T18:41:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75692024-11-27T18:41:01.440ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.828864ms iteration = 14 status = 0
75702024-11-27T18:41:01.441ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75712024-11-27T18:41:01.441ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.458684ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75722024-11-27T18:41:01.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75732024-11-27T18:41:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75742024-11-27T18:41:01.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75752024-11-27T18:41:01.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.125952ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
75762024-11-27T18:41:01.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75772024-11-27T18:41:01.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75782024-11-27T18:41:01.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.863903ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75792024-11-27T18:41:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75802024-11-27T18:41:01.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75812024-11-27T18:41:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75822024-11-27T18:41:01.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75832024-11-27T18:41:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75842024-11-27T18:41:01.474ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75852024-11-27T18:41:01.474ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75862024-11-27T18:41:01.474ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.535723ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75872024-11-27T18:41:01.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75882024-11-27T18:41:01.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75892024-11-27T18:41:01.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.039819ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
75902024-11-27T18:41:01.497ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.389963ms iteration = 16 status = {"physical_disks_added":0}
75912024-11-27T18:41:01.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.426591ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
75922024-11-27T18:41:01.507ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75932024-11-27T18:41:01.507ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75942024-11-27T18:41:01.507ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3a035ea-1f60-4cf3-ae01-0ae43dd7b6c0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
75952024-11-27T18:41:01.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75962024-11-27T18:41:01.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75972024-11-27T18:41:01.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75982024-11-27T18:41:01.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75992024-11-27T18:41:01.526ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
76002024-11-27T18:41:01.526ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76012024-11-27T18:41:01.526ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98865d01-40e6-47fe-98bc-b78a24526058", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76022024-11-27T18:41:01.526ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76032024-11-27T18:41:01.528ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
76042024-11-27T18:41:01.530ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76052024-11-27T18:41:01.530ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76062024-11-27T18:41:01.531ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c91fa6b3-7fdd-4c6a-ab2b-b3cadffaa805", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76072024-11-27T18:41:01.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76082024-11-27T18:41:01.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76092024-11-27T18:41:01.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76102024-11-27T18:41:01.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76112024-11-27T18:41:01.635ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76122024-11-27T18:41:01.636ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "83fc18c0-677d-46a4-a845-f88d6539a075", "content-length": "1", "date": "Wed, 27 Nov 2024 18:41:00 GMT"} })
76132024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76142024-11-27T18:41:01.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76152024-11-27T18:41:01.669ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76162024-11-27T18:41:01.669ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76172024-11-27T18:41:01.670ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b330b64d-d121-4a38-99a7-2960baa2339a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76182024-11-27T18:41:01.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76192024-11-27T18:41:01.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76202024-11-27T18:41:01.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212024-11-27T18:41:01.672ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.01499ms iteration = 14 status = null
76222024-11-27T18:41:01.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76232024-11-27T18:41:01.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76242024-11-27T18:41:01.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76252024-11-27T18:41:01.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76262024-11-27T18:41:01.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76272024-11-27T18:41:01.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76282024-11-27T18:41:01.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76292024-11-27T18:41:01.685ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76302024-11-27T18:41:01.685ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76312024-11-27T18:41:01.686ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "75d072bd-bcb9-498d-93e1-71cdc2e56785", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76322024-11-27T18:41:01.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76332024-11-27T18:41:01.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76342024-11-27T18:41:01.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76352024-11-27T18:41:01.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76362024-11-27T18:41:01.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76372024-11-27T18:41:01.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76382024-11-27T18:41:01.694ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.19165ms iteration = 14 status = {}
76392024-11-27T18:41:01.694ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76402024-11-27T18:41:01.694ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76412024-11-27T18:41:01.695ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6e770c05-5b52-4cb3-b142-d017ceb903f5", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76422024-11-27T18:41:01.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.59024ms iteration = 14 status = {}
76432024-11-27T18:41:01.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb8356cb-3bdc-4b44-8ef3-e54dfaf781ae roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76442024-11-27T18:41:01.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb8356cb-3bdc-4b44-8ef3-e54dfaf781ae resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76452024-11-27T18:41:01.754ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76462024-11-27T18:41:01.754ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae200709-2911-45da-8ced-755b15919779", "content-length": "691", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76472024-11-27T18:41:01.754ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76482024-11-27T18:41:01.754ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76492024-11-27T18:41:01.754ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76502024-11-27T18:41:01.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = eb8356cb-3bdc-4b44-8ef3-e54dfaf781ae response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76512024-11-27T18:41:01.757ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 365.75742ms iteration = 14 status = {}
76522024-11-27T18:41:01.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76532024-11-27T18:41:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76542024-11-27T18:41:01.779ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
76552024-11-27T18:41:01.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76562024-11-27T18:41:01.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76572024-11-27T18:41:01.796ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76582024-11-27T18:41:01.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d835adf0-4722-46ec-b32a-ceca1d64649c", "content-length": "134", "date": "Wed, 27 Nov 2024 18:41:00 GMT"} })
76592024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76602024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
76612024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76622024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76632024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76642024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76652024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76662024-11-27T18:41:01.797ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76672024-11-27T18:41:01.798ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76682024-11-27T18:41:01.798ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76692024-11-27T18:41:01.798ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
76702024-11-27T18:41:01.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76712024-11-27T18:41:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76722024-11-27T18:41:01.800ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76732024-11-27T18:41:01.800ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aacf79d-4472-4431-b47c-c41b4e033cd8", "content-length": "2", "date": "Wed, 27 Nov 2024 18:41:00 GMT"} })
76742024-11-27T18:41:01.800ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76752024-11-27T18:41:01.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5735926c-0e13-41ac-88d1-8a95ffd7f331", "content-length": "52", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76762024-11-27T18:41:01.801ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
76772024-11-27T18:41:01.801ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76782024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fca30843-7775-4391-b579-24ff88a85bb8", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76792024-11-27T18:41:01.909ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
76802024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76812024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9d94170-5b1a-4374-b330-6a1903149fd7", "content-length": "682", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
76822024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76832024-11-27T18:41:01.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76842024-11-27T18:41:01.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76852024-11-27T18:41:01.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76862024-11-27T18:41:01.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76872024-11-27T18:41:01.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76882024-11-27T18:41:01.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76892024-11-27T18:41:01.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76902024-11-27T18:41:01.927ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 535.384405ms iteration = 14 status = {}
76912024-11-27T18:41:02.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = bf6d572e-1b3f-4b6d-a8fd-4f0b509eea4d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
76922024-11-27T18:41:02.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = bf6d572e-1b3f-4b6d-a8fd-4f0b509eea4d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
76932024-11-27T18:41:02.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = bf6d572e-1b3f-4b6d-a8fd-4f0b509eea4d response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
76942024-11-27T18:41:02.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2553a650-c8c9-49d1-afb4-14b1e12aa81c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76952024-11-27T18:41:02.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2553a650-c8c9-49d1-afb4-14b1e12aa81c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76962024-11-27T18:41:02.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2553a650-c8c9-49d1-afb4-14b1e12aa81c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76972024-11-27T18:41:03.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 844c7978-51fe-44df-abfa-9a287936fcaa response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
76982024-11-27T18:41:03.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b567a040-df05-43aa-b06e-f1099db77fa2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
76992024-11-27T18:41:03.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b567a040-df05-43aa-b06e-f1099db77fa2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77002024-11-27T18:41:03.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b567a040-df05-43aa-b06e-f1099db77fa2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77012024-11-27T18:41:04.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a2e29e6-d70e-4bd6-97d1-c488abd58e03 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77022024-11-27T18:41:04.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a2e29e6-d70e-4bd6-97d1-c488abd58e03 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77032024-11-27T18:41:04.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4a2e29e6-d70e-4bd6-97d1-c488abd58e03 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77042024-11-27T18:41:05.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2315f42-7c8c-4a7c-9377-3707d3797d22 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77052024-11-27T18:41:05.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2315f42-7c8c-4a7c-9377-3707d3797d22 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77062024-11-27T18:41:05.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2315f42-7c8c-4a7c-9377-3707d3797d22 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77072024-11-27T18:41:06.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 027a938c-795b-4f27-a462-6f62279bd1e0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77082024-11-27T18:41:06.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 027a938c-795b-4f27-a462-6f62279bd1e0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77092024-11-27T18:41:06.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 027a938c-795b-4f27-a462-6f62279bd1e0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77102024-11-27T18:41:07.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1cf4a885-c1c2-4939-a67c-9cf41e4b1192 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77112024-11-27T18:41:07.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1cf4a885-c1c2-4939-a67c-9cf41e4b1192 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77122024-11-27T18:41:07.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1cf4a885-c1c2-4939-a67c-9cf41e4b1192 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77132024-11-27T18:41:08.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 69e72412-f56f-4579-a5de-eb20045360c9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77142024-11-27T18:41:08.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 69e72412-f56f-4579-a5de-eb20045360c9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77152024-11-27T18:41:08.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 69e72412-f56f-4579-a5de-eb20045360c9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77162024-11-27T18:41:09.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ba5a64b0-4d43-4538-8fed-3a4fe0e7c36f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77172024-11-27T18:41:09.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ba5a64b0-4d43-4538-8fed-3a4fe0e7c36f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77182024-11-27T18:41:09.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ba5a64b0-4d43-4538-8fed-3a4fe0e7c36f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77192024-11-27T18:41:10.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f0ebe13-6da9-488e-b29c-6f1ff55f77e2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77202024-11-27T18:41:10.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f0ebe13-6da9-488e-b29c-6f1ff55f77e2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77212024-11-27T18:41:10.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f0ebe13-6da9-488e-b29c-6f1ff55f77e2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77222024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
77232024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77242024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77252024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
77262024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77272024-11-27T18:41:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77282024-11-27T18:41:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77292024-11-27T18:41:11.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77302024-11-27T18:41:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77312024-11-27T18:41:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.725805ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77322024-11-27T18:41:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77332024-11-27T18:41:11.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77342024-11-27T18:41:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77352024-11-27T18:41:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77362024-11-27T18:41:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77372024-11-27T18:41:11.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77382024-11-27T18:41:11.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
77392024-11-27T18:41:11.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77402024-11-27T18:41:11.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77412024-11-27T18:41:11.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
77422024-11-27T18:41:11.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.738418ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
77432024-11-27T18:41:11.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2242d6bb-bda4-4a9a-a65d-edb7b90107a1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77442024-11-27T18:41:11.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2242d6bb-bda4-4a9a-a65d-edb7b90107a1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77452024-11-27T18:41:11.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2242d6bb-bda4-4a9a-a65d-edb7b90107a1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77462024-11-27T18:41:12.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e99ef4e8-1de1-41a0-a800-b47dcf797db5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77472024-11-27T18:41:12.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e99ef4e8-1de1-41a0-a800-b47dcf797db5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77482024-11-27T18:41:12.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e99ef4e8-1de1-41a0-a800-b47dcf797db5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77492024-11-27T18:41:13.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 6df8d8ad-19dc-4fcf-bf48-e5dfce123344 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
77502024-11-27T18:41:14.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 565112a4-fe05-4c89-9864-cf1401ac3a49 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77512024-11-27T18:41:14.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 565112a4-fe05-4c89-9864-cf1401ac3a49 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77522024-11-27T18:41:14.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 565112a4-fe05-4c89-9864-cf1401ac3a49 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77532024-11-27T18:41:15.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10afeecf-e3f5-4d60-ad2b-00bca206e9db roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77542024-11-27T18:41:15.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10afeecf-e3f5-4d60-ad2b-00bca206e9db resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77552024-11-27T18:41:15.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 10afeecf-e3f5-4d60-ad2b-00bca206e9db response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77562024-11-27T18:41:16.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73178434-dac0-4332-9083-2920b403f954 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77572024-11-27T18:41:16.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73178434-dac0-4332-9083-2920b403f954 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77582024-11-27T18:41:16.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 73178434-dac0-4332-9083-2920b403f954 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77592024-11-27T18:41:17.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7d37b0-356b-4eac-900d-c8c2a4890f0a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77602024-11-27T18:41:17.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7d37b0-356b-4eac-900d-c8c2a4890f0a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77612024-11-27T18:41:17.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2c7d37b0-356b-4eac-900d-c8c2a4890f0a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77622024-11-27T18:41:18.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9af8ac2-1169-445b-afba-dc580239525f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77632024-11-27T18:41:18.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9af8ac2-1169-445b-afba-dc580239525f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77642024-11-27T18:41:18.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9af8ac2-1169-445b-afba-dc580239525f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77652024-11-27T18:41:19.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0e3e545-6da1-4f91-8910-f9daaafbc847 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77662024-11-27T18:41:19.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0e3e545-6da1-4f91-8910-f9daaafbc847 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77672024-11-27T18:41:19.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c0e3e545-6da1-4f91-8910-f9daaafbc847 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77682024-11-27T18:41:20.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02af977e-e631-44aa-b026-716ee3c04ce0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77692024-11-27T18:41:20.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02af977e-e631-44aa-b026-716ee3c04ce0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77702024-11-27T18:41:20.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 02af977e-e631-44aa-b026-716ee3c04ce0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77712024-11-27T18:41:21.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6fc70e6-2ee4-4f70-983e-d84ccc7f822b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77722024-11-27T18:41:21.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6fc70e6-2ee4-4f70-983e-d84ccc7f822b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77732024-11-27T18:41:21.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6fc70e6-2ee4-4f70-983e-d84ccc7f822b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77742024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
77752024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77762024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77772024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
77782024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77792024-11-27T18:41:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77802024-11-27T18:41:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77812024-11-27T18:41:21.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77822024-11-27T18:41:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77832024-11-27T18:41:21.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.764156ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77842024-11-27T18:41:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77852024-11-27T18:41:21.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77862024-11-27T18:41:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77872024-11-27T18:41:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77882024-11-27T18:41:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77892024-11-27T18:41:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902024-11-27T18:41:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
77912024-11-27T18:41:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77922024-11-27T18:41:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77932024-11-27T18:41:21.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
77942024-11-27T18:41:21.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.069213ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
77952024-11-27T18:41:22.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b30f8f9-4f2c-4df8-8ba4-282e87f543cb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77962024-11-27T18:41:22.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b30f8f9-4f2c-4df8-8ba4-282e87f543cb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77972024-11-27T18:41:22.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3b30f8f9-4f2c-4df8-8ba4-282e87f543cb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77982024-11-27T18:41:23.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 103e0c3e-baab-4c2c-977a-f7ddfa96b68a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
77992024-11-27T18:41:23.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 103e0c3e-baab-4c2c-977a-f7ddfa96b68a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78002024-11-27T18:41:23.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 103e0c3e-baab-4c2c-977a-f7ddfa96b68a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78012024-11-27T18:41:23.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 9dfe518d-1de8-452e-8989-d72723ef6725 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
78022024-11-27T18:41:24.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f23f4ee9-8f00-4678-8601-01c0d3540281 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78032024-11-27T18:41:24.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f23f4ee9-8f00-4678-8601-01c0d3540281 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78042024-11-27T18:41:24.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f23f4ee9-8f00-4678-8601-01c0d3540281 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78052024-11-27T18:41:25.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41593eda-257a-4b2f-b179-f597125f6f61 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78062024-11-27T18:41:25.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41593eda-257a-4b2f-b179-f597125f6f61 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78072024-11-27T18:41:25.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 41593eda-257a-4b2f-b179-f597125f6f61 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78082024-11-27T18:41:26.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fee6f1-f3dc-46b7-9ab4-1fb8112dedb9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78092024-11-27T18:41:26.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fee6f1-f3dc-46b7-9ab4-1fb8112dedb9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78102024-11-27T18:41:26.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28fee6f1-f3dc-46b7-9ab4-1fb8112dedb9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78112024-11-27T18:41:27.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 319dba5f-09dc-4798-80ea-6f1069dce1ee roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78122024-11-27T18:41:27.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 319dba5f-09dc-4798-80ea-6f1069dce1ee resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78132024-11-27T18:41:27.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 319dba5f-09dc-4798-80ea-6f1069dce1ee response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78142024-11-27T18:41:28.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 114137d9-da50-4198-ab65-4fb2a54e06a9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78152024-11-27T18:41:28.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 114137d9-da50-4198-ab65-4fb2a54e06a9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78162024-11-27T18:41:28.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 114137d9-da50-4198-ab65-4fb2a54e06a9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78172024-11-27T18:41:28.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4611f9ef-d87f-4440-8b04-d67e9e9d24a7 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
78182024-11-27T18:41:28.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4611f9ef-d87f-4440-8b04-d67e9e9d24a7 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
78192024-11-27T18:41:28.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 4611f9ef-d87f-4440-8b04-d67e9e9d24a7 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
78202024-11-27T18:41:28.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = d0d25ecc-95ac-490c-b430-018f6647becc roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
78212024-11-27T18:41:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = d0d25ecc-95ac-490c-b430-018f6647becc resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
78222024-11-27T18:41:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = d0d25ecc-95ac-490c-b430-018f6647becc response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
78232024-11-27T18:41:29.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ea923a-5ebe-4ca1-b8d5-3562e4e04f47 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78242024-11-27T18:41:29.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ea923a-5ebe-4ca1-b8d5-3562e4e04f47 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78252024-11-27T18:41:29.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82ea923a-5ebe-4ca1-b8d5-3562e4e04f47 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78262024-11-27T18:41:30.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d2bc9d5d-7406-47b4-be68-546756d951b3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78272024-11-27T18:41:30.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d2bc9d5d-7406-47b4-be68-546756d951b3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78282024-11-27T18:41:30.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d2bc9d5d-7406-47b4-be68-546756d951b3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78292024-11-27T18:41:31.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fbeabca-122b-4567-bf8c-8d71f4b9727a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78302024-11-27T18:41:31.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fbeabca-122b-4567-bf8c-8d71f4b9727a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78312024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78322024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
78332024-11-27T18:41:31.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
78342024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78352024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.951\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
78362024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
78372024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
78382024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78392024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78402024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78412024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78422024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
78432024-11-27T18:41:31.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78442024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
78452024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78462024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78472024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78482024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
78492024-11-27T18:41:31.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fbeabca-122b-4567-bf8c-8d71f4b9727a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
78502024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
78512024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78522024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
78532024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78542024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
78552024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78562024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
78572024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
78582024-11-27T18:41:31.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78592024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78602024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
78612024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78622024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78632024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78642024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78652024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78662024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
78672024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
78682024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
78692024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78702024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
78712024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
78722024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78732024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78742024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
78752024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
78762024-11-27T18:41:31.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:31:31.392088415 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
78772024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78782024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
78792024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78802024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78812024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78822024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78832024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78842024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
78852024-11-27T18:41:31.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78862024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78872024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78882024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78892024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78902024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78912024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78922024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78932024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78942024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78952024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78962024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
78972024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
78982024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78992024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79002024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
79012024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79022024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
79032024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79042024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
79052024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79062024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
79072024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79082024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79092024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79102024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79112024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79122024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79132024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79142024-11-27T18:41:31.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 389359680 } })
79152024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79162024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79172024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79182024-11-27T18:41:31.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79192024-11-27T18:41:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 389689565 } })
79202024-11-27T18:41:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
79212024-11-27T18:41:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.161207ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
79222024-11-27T18:41:31.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
79232024-11-27T18:41:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 999.524\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
79242024-11-27T18:41:31.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79252024-11-27T18:41:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.080016ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
79262024-11-27T18:41:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.173857ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
79272024-11-27T18:41:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79282024-11-27T18:41:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79292024-11-27T18:41:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.943098ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79302024-11-27T18:41:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79312024-11-27T18:41:31.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79322024-11-27T18:41:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79332024-11-27T18:41:31.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79342024-11-27T18:41:31.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79352024-11-27T18:41:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79362024-11-27T18:41:31.398ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372024-11-27T18:41:31.399ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.938338ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
79382024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79392024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79402024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79422024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79432024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79442024-11-27T18:41:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79452024-11-27T18:41:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79462024-11-27T18:41:31.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79472024-11-27T18:41:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79482024-11-27T18:41:31.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79492024-11-27T18:41:31.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 399956347 } })
79502024-11-27T18:41:31.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
79512024-11-27T18:41:31.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79522024-11-27T18:41:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79532024-11-27T18:41:31.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79542024-11-27T18:41:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79552024-11-27T18:41:31.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79562024-11-27T18:41:31.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79572024-11-27T18:41:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79582024-11-27T18:41:31.405ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:31:31.392088415 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
79592024-11-27T18:41:31.405ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.007732ms iteration = 8 status = {"expiration":"2024-11-27T18:31:31.392088415Z","pruned":[]}
79602024-11-27T18:41:31.405ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79612024-11-27T18:41:31.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79622024-11-27T18:41:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79632024-11-27T18:41:31.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79642024-11-27T18:41:31.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79652024-11-27T18:41:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79662024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79672024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79682024-11-27T18:41:31.409ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79692024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.9199ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79702024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79712024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79722024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79732024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79742024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79752024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79762024-11-27T18:41:31.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 406511184 } })
79772024-11-27T18:41:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79782024-11-27T18:41:31.410ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
79792024-11-27T18:41:31.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79802024-11-27T18:41:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79812024-11-27T18:41:31.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79822024-11-27T18:41:31.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79832024-11-27T18:41:31.413ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 410615175 } })
79842024-11-27T18:41:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79852024-11-27T18:41:31.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79862024-11-27T18:41:31.414ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
79872024-11-27T18:41:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79882024-11-27T18:41:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79892024-11-27T18:41:31.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79902024-11-27T18:41:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79912024-11-27T18:41:31.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79922024-11-27T18:41:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79932024-11-27T18:41:31.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79942024-11-27T18:41:31.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79952024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
79962024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79972024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79982024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79992024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80002024-11-27T18:41:31.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80012024-11-27T18:41:31.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-11-27T18:41:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80032024-11-27T18:41:31.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80042024-11-27T18:41:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80052024-11-27T18:41:31.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80062024-11-27T18:41:31.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80072024-11-27T18:41:31.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80082024-11-27T18:41:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80092024-11-27T18:41:31.448ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80102024-11-27T18:41:31.448ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80112024-11-27T18:41:31.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80122024-11-27T18:41:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80132024-11-27T18:41:31.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80142024-11-27T18:41:31.451ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80152024-11-27T18:41:31.451ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80162024-11-27T18:41:31.451ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.011819ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80172024-11-27T18:41:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80182024-11-27T18:41:31.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80192024-11-27T18:41:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80202024-11-27T18:41:31.452ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
80212024-11-27T18:41:31.452ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.909063ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
80222024-11-27T18:41:31.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80232024-11-27T18:41:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80242024-11-27T18:41:31.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.036604ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80252024-11-27T18:41:31.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80262024-11-27T18:41:31.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.865472ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80272024-11-27T18:41:31.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
80282024-11-27T18:41:31.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80292024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80302024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
80312024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
80322024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
80332024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80342024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80352024-11-27T18:41:31.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80362024-11-27T18:41:31.459ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
80372024-11-27T18:41:31.459ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
80382024-11-27T18:41:31.459ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.026633ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
80392024-11-27T18:41:31.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80402024-11-27T18:41:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.551396ms iteration = 15 status = 0
80412024-11-27T18:41:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.702859ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80422024-11-27T18:41:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80432024-11-27T18:41:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80442024-11-27T18:41:31.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80452024-11-27T18:41:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80462024-11-27T18:41:31.465ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80472024-11-27T18:41:31.465ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
80482024-11-27T18:41:31.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80492024-11-27T18:41:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80502024-11-27T18:41:31.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-11-27T18:41:31.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80522024-11-27T18:41:31.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80532024-11-27T18:41:31.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80542024-11-27T18:41:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80552024-11-27T18:41:31.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 78.865339ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80562024-11-27T18:41:31.471ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80572024-11-27T18:41:31.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.595894ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80582024-11-27T18:41:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80592024-11-27T18:41:31.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80602024-11-27T18:41:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80612024-11-27T18:41:31.473ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
80622024-11-27T18:41:31.473ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80632024-11-27T18:41:31.473ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
80642024-11-27T18:41:31.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 81.710671ms iteration = 8 status = {"generation":2}
80652024-11-27T18:41:31.474ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80662024-11-27T18:41:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80672024-11-27T18:41:31.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80682024-11-27T18:41:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80692024-11-27T18:41:31.478ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702024-11-27T18:41:31.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80712024-11-27T18:41:31.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80722024-11-27T18:41:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80732024-11-27T18:41:31.481ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 89.73422ms iteration = 17 status = {"physical_disks_added":0}
80742024-11-27T18:41:31.492ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80752024-11-27T18:41:31.492ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80762024-11-27T18:41:31.492ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80772024-11-27T18:41:31.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80782024-11-27T18:41:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80792024-11-27T18:41:31.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80802024-11-27T18:41:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80812024-11-27T18:41:31.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80822024-11-27T18:41:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80832024-11-27T18:41:31.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80842024-11-27T18:41:31.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80852024-11-27T18:41:31.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80862024-11-27T18:41:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80872024-11-27T18:41:31.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80882024-11-27T18:41:31.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80892024-11-27T18:41:31.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80902024-11-27T18:41:31.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80912024-11-27T18:41:31.507ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80922024-11-27T18:41:31.507ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80932024-11-27T18:41:31.507ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
80942024-11-27T18:41:31.507ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 115.236458ms iteration = 8 status = {"generation":1}
80952024-11-27T18:41:31.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80962024-11-27T18:41:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80972024-11-27T18:41:31.523ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
80982024-11-27T18:41:31.523ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.482749ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80992024-11-27T18:41:31.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81002024-11-27T18:41:31.539ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
81012024-11-27T18:41:31.539ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 147.528807ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
81022024-11-27T18:41:31.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81032024-11-27T18:41:31.556ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81042024-11-27T18:41:31.556ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81052024-11-27T18:41:31.556ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32e3581c-0d2d-4654-ac8d-fefcfbecd70e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81062024-11-27T18:41:31.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81072024-11-27T18:41:31.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81082024-11-27T18:41:31.618ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81092024-11-27T18:41:31.618ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81102024-11-27T18:41:31.619ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9f476f0-fad3-4d7d-907a-10746d15059b", "content-length": "372", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81112024-11-27T18:41:31.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81122024-11-27T18:41:31.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81132024-11-27T18:41:31.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81142024-11-27T18:41:31.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81152024-11-27T18:41:31.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-11-27T18:41:31.644ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81172024-11-27T18:41:31.644ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81182024-11-27T18:41:31.644ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7162e6d-7ebb-4586-85da-26c0c6ca4c41", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81192024-11-27T18:41:31.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81202024-11-27T18:41:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81212024-11-27T18:41:31.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81222024-11-27T18:41:31.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81232024-11-27T18:41:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81242024-11-27T18:41:31.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81252024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81262024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81272024-11-27T18:41:31.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81282024-11-27T18:41:31.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81292024-11-27T18:41:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81302024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81312024-11-27T18:41:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81322024-11-27T18:41:31.664ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81332024-11-27T18:41:31.665ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81342024-11-27T18:41:31.665ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cdc8449c-b40d-4809-9881-e801b3f93d28", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81352024-11-27T18:41:31.667ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 275.377502ms iteration = 15 status = {}
81362024-11-27T18:41:31.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
81372024-11-27T18:41:31.719ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81382024-11-27T18:41:31.719ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6cb1529-ee9b-4b0c-9819-7a99308a4693", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81392024-11-27T18:41:31.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81402024-11-27T18:41:31.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
81412024-11-27T18:41:31.722ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
81422024-11-27T18:41:31.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81432024-11-27T18:41:31.725ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81442024-11-27T18:41:31.725ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3beeea9b-d51d-4776-b0e2-0ec70cfbe221", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81452024-11-27T18:41:31.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81462024-11-27T18:41:31.726ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81472024-11-27T18:41:31.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81482024-11-27T18:41:31.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5b8ec7ba-76ed-45b2-8fbc-9f96e8d016ce", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81492024-11-27T18:41:31.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81502024-11-27T18:41:31.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4801df59-735c-4de1-afa5-b12b127bfeb5", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81512024-11-27T18:41:31.728ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81522024-11-27T18:41:31.729ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81532024-11-27T18:41:31.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 338.057751ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81542024-11-27T18:41:31.730ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.362946ms iteration = 15 status = {}
81552024-11-27T18:41:31.796ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81562024-11-27T18:41:31.797ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "90a1c996-1d1a-4c42-94c8-d6ef8e958b2c", "content-length": "691", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81572024-11-27T18:41:31.797ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81582024-11-27T18:41:31.797ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81592024-11-27T18:41:31.797ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81602024-11-27T18:41:31.798ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.643637ms iteration = 15 status = {}
81612024-11-27T18:41:31.833ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81622024-11-27T18:41:31.834ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81632024-11-27T18:41:31.834ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "53881643-8d4f-449c-9b81-b9329a1284a3", "content-length": "1", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81642024-11-27T18:41:31.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b8bb7ad-c84b-4916-a449-06f2af8a9e70", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81652024-11-27T18:41:31.834ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81662024-11-27T18:41:31.834ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81672024-11-27T18:41:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81682024-11-27T18:41:31.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aca80b92-32e6-4e36-a32a-7ae68b7993be", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81692024-11-27T18:41:31.836ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81702024-11-27T18:41:31.836ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 444.387906ms iteration = 15 status = null
81712024-11-27T18:41:31.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f1591421-a497-4000-a7d3-4ed2645b92fb", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81722024-11-27T18:41:31.838ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81732024-11-27T18:41:31.840ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
81742024-11-27T18:41:31.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 448.570098ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81752024-11-27T18:41:31.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81762024-11-27T18:41:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81772024-11-27T18:41:31.898ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
81782024-11-27T18:41:31.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81792024-11-27T18:41:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81802024-11-27T18:41:31.908ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81812024-11-27T18:41:31.908ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2642545-3467-43d3-8658-cbd0dce98cbb", "content-length": "134", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81822024-11-27T18:41:31.908ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81832024-11-27T18:41:31.908ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
81842024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81852024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81862024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81872024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81882024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81892024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81902024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81912024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81922024-11-27T18:41:31.909ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
81932024-11-27T18:41:31.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81942024-11-27T18:41:31.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81952024-11-27T18:41:31.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81962024-11-27T18:41:31.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d2002cb-20ec-4b47-b7dd-bf20ba113557", "content-length": "2", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81972024-11-27T18:41:31.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81982024-11-27T18:41:31.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8bc5420-3b55-4e0d-a46a-809c53784ab1", "content-length": "52", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
81992024-11-27T18:41:31.912ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
82002024-11-27T18:41:31.912ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82012024-11-27T18:41:32.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "67527448-0584-421a-977b-0705f3196a36", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
82022024-11-27T18:41:32.047ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
82032024-11-27T18:41:32.047ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82042024-11-27T18:41:32.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cff9518-827c-40ac-89da-e2e2e1ec6053", "content-length": "682", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
82052024-11-27T18:41:32.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82062024-11-27T18:41:32.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82072024-11-27T18:41:32.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82082024-11-27T18:41:32.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82092024-11-27T18:41:32.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82102024-11-27T18:41:32.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82112024-11-27T18:41:32.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82122024-11-27T18:41:32.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82132024-11-27T18:41:32.066ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.776112ms iteration = 15 status = {}
82142024-11-27T18:41:32.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a9f21e5-0373-4e7c-a541-26bc9f3a1565 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82152024-11-27T18:41:32.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a9f21e5-0373-4e7c-a541-26bc9f3a1565 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82162024-11-27T18:41:32.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6a9f21e5-0373-4e7c-a541-26bc9f3a1565 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82172024-11-27T18:41:32.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 471f3a13-571a-445d-965e-2522d49a7ea5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
82182024-11-27T18:41:32.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 471f3a13-571a-445d-965e-2522d49a7ea5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
82192024-11-27T18:41:32.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 471f3a13-571a-445d-965e-2522d49a7ea5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
82202024-11-27T18:41:33.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f43621c-9a2a-4346-8bcb-81011ab43a2e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82212024-11-27T18:41:33.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f43621c-9a2a-4346-8bcb-81011ab43a2e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82222024-11-27T18:41:33.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8f43621c-9a2a-4346-8bcb-81011ab43a2e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82232024-11-27T18:41:33.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 574 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 88fba9f2-0a38-4370-b3fb-5ac38c58956b response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
82242024-11-27T18:41:34.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35e08a27-cc7a-4cb9-bdec-bbf235663b44 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82252024-11-27T18:41:34.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35e08a27-cc7a-4cb9-bdec-bbf235663b44 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82262024-11-27T18:41:34.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 35e08a27-cc7a-4cb9-bdec-bbf235663b44 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82272024-11-27T18:41:35.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a82e21a6-4bef-4c62-9ecf-560c8bc5cbe7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82282024-11-27T18:41:35.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a82e21a6-4bef-4c62-9ecf-560c8bc5cbe7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82292024-11-27T18:41:35.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a82e21a6-4bef-4c62-9ecf-560c8bc5cbe7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82302024-11-27T18:41:36.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 430aa8e1-5cb3-453b-8f9f-3869c5b5c507 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82312024-11-27T18:41:36.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 430aa8e1-5cb3-453b-8f9f-3869c5b5c507 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82322024-11-27T18:41:36.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 430aa8e1-5cb3-453b-8f9f-3869c5b5c507 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82332024-11-27T18:41:37.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = feb5faad-ab94-43e9-9fe6-89ef5342181f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82342024-11-27T18:41:37.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = feb5faad-ab94-43e9-9fe6-89ef5342181f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82352024-11-27T18:41:37.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = feb5faad-ab94-43e9-9fe6-89ef5342181f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82362024-11-27T18:41:38.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad8647e9-42a2-433f-90e5-079822f065dd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82372024-11-27T18:41:38.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad8647e9-42a2-433f-90e5-079822f065dd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82382024-11-27T18:41:38.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ad8647e9-42a2-433f-90e5-079822f065dd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82392024-11-27T18:41:39.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b34de801-c65d-4e74-bc4c-df0b6038bf52 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82402024-11-27T18:41:39.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b34de801-c65d-4e74-bc4c-df0b6038bf52 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82412024-11-27T18:41:39.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b34de801-c65d-4e74-bc4c-df0b6038bf52 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82422024-11-27T18:41:40.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf962cd-c04e-45fd-bd1e-ebeeea81ea01 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82432024-11-27T18:41:40.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf962cd-c04e-45fd-bd1e-ebeeea81ea01 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82442024-11-27T18:41:40.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = faf962cd-c04e-45fd-bd1e-ebeeea81ea01 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82452024-11-27T18:41:41.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
82462024-11-27T18:41:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82472024-11-27T18:41:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82482024-11-27T18:41:41.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
82492024-11-27T18:41:41.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82502024-11-27T18:41:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82512024-11-27T18:41:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82522024-11-27T18:41:41.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82532024-11-27T18:41:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82542024-11-27T18:41:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.191778ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82552024-11-27T18:41:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82562024-11-27T18:41:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82572024-11-27T18:41:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82582024-11-27T18:41:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82592024-11-27T18:41:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82602024-11-27T18:41:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82612024-11-27T18:41:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
82622024-11-27T18:41:41.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82632024-11-27T18:41:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82642024-11-27T18:41:41.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
82652024-11-27T18:41:41.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.505824ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
82662024-11-27T18:41:41.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45eb0c47-4ead-4ea6-b2ad-78d9d2816946 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82672024-11-27T18:41:41.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45eb0c47-4ead-4ea6-b2ad-78d9d2816946 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82682024-11-27T18:41:41.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 45eb0c47-4ead-4ea6-b2ad-78d9d2816946 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82692024-11-27T18:41:42.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f506f47d-c559-4318-9c9d-3872e4125a35 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82702024-11-27T18:41:42.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f506f47d-c559-4318-9c9d-3872e4125a35 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82712024-11-27T18:41:42.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f506f47d-c559-4318-9c9d-3872e4125a35 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82722024-11-27T18:41:43.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 604 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = d48d8c05-9314-4af3-b5ee-78d434b895ab response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
82732024-11-27T18:41:43.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b13b027-429f-4187-b707-830340958e4c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82742024-11-27T18:41:43.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b13b027-429f-4187-b707-830340958e4c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82752024-11-27T18:41:43.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b13b027-429f-4187-b707-830340958e4c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82762024-11-27T18:41:44.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ec8ef649-7448-4bef-94f7-9cf8caf610c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82772024-11-27T18:41:44.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ec8ef649-7448-4bef-94f7-9cf8caf610c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82782024-11-27T18:41:44.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ec8ef649-7448-4bef-94f7-9cf8caf610c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82792024-11-27T18:41:45.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9b26f6c-325f-42cf-9f39-ccf6f409454b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82802024-11-27T18:41:45.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9b26f6c-325f-42cf-9f39-ccf6f409454b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82812024-11-27T18:41:45.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9b26f6c-325f-42cf-9f39-ccf6f409454b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82822024-11-27T18:41:46.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e0fe438-8df0-4639-a807-9cb0a3927169 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82832024-11-27T18:41:46.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e0fe438-8df0-4639-a807-9cb0a3927169 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82842024-11-27T18:41:46.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2e0fe438-8df0-4639-a807-9cb0a3927169 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82852024-11-27T18:41:47.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 690dc657-0b8c-483b-9d17-a80d6dc32106 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82862024-11-27T18:41:47.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 690dc657-0b8c-483b-9d17-a80d6dc32106 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82872024-11-27T18:41:47.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 690dc657-0b8c-483b-9d17-a80d6dc32106 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82882024-11-27T18:41:48.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b745b99a-1dc2-4db4-809e-a277c593e680 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82892024-11-27T18:41:48.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b745b99a-1dc2-4db4-809e-a277c593e680 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82902024-11-27T18:41:48.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b745b99a-1dc2-4db4-809e-a277c593e680 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82912024-11-27T18:41:49.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e773629a-3f7f-4f5a-bef5-f161de557ecc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82922024-11-27T18:41:49.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e773629a-3f7f-4f5a-bef5-f161de557ecc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82932024-11-27T18:41:49.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e773629a-3f7f-4f5a-bef5-f161de557ecc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82942024-11-27T18:41:50.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a897bb95-a8c3-469f-b7ec-a05ae1a6afda roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82952024-11-27T18:41:50.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a897bb95-a8c3-469f-b7ec-a05ae1a6afda resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82962024-11-27T18:41:50.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a897bb95-a8c3-469f-b7ec-a05ae1a6afda response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
82972024-11-27T18:41:51.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82982024-11-27T18:41:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82992024-11-27T18:41:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83002024-11-27T18:41:51.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
83012024-11-27T18:41:51.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83022024-11-27T18:41:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83032024-11-27T18:41:51.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83042024-11-27T18:41:51.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83052024-11-27T18:41:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83062024-11-27T18:41:51.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.678635ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83072024-11-27T18:41:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83082024-11-27T18:41:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83092024-11-27T18:41:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83102024-11-27T18:41:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83112024-11-27T18:41:51.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83122024-11-27T18:41:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83132024-11-27T18:41:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
83142024-11-27T18:41:51.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83152024-11-27T18:41:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83162024-11-27T18:41:51.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
83172024-11-27T18:41:51.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.062797ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
83182024-11-27T18:41:51.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3aeed775-4a92-481a-9213-bc8d413c2c81 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83192024-11-27T18:41:51.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3aeed775-4a92-481a-9213-bc8d413c2c81 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83202024-11-27T18:41:51.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3aeed775-4a92-481a-9213-bc8d413c2c81 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83212024-11-27T18:41:52.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee90ff47-5801-4198-9a45-0738d858dd50 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83222024-11-27T18:41:52.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee90ff47-5801-4198-9a45-0738d858dd50 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83232024-11-27T18:41:52.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee90ff47-5801-4198-9a45-0738d858dd50 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83242024-11-27T18:41:53.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 282b2568-ddb9-4e43-b0e7-0dff0fc4bbbc response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
83252024-11-27T18:41:53.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61d373dd-b9ae-4b15-a2fa-e057a9072399 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83262024-11-27T18:41:53.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61d373dd-b9ae-4b15-a2fa-e057a9072399 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83272024-11-27T18:41:53.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 61d373dd-b9ae-4b15-a2fa-e057a9072399 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83282024-11-27T18:41:54.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b67eefb5-6b12-4659-8356-1e11f9493508 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83292024-11-27T18:41:54.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b67eefb5-6b12-4659-8356-1e11f9493508 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83302024-11-27T18:41:54.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b67eefb5-6b12-4659-8356-1e11f9493508 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83312024-11-27T18:41:55.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8b3a81c5-50b0-46fd-af81-cc02a55b5914 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83322024-11-27T18:41:55.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8b3a81c5-50b0-46fd-af81-cc02a55b5914 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83332024-11-27T18:41:55.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8b3a81c5-50b0-46fd-af81-cc02a55b5914 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83342024-11-27T18:41:56.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c99539-66aa-43e5-b183-3d0ddb14ab3b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83352024-11-27T18:41:56.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c99539-66aa-43e5-b183-3d0ddb14ab3b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83362024-11-27T18:41:56.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 25c99539-66aa-43e5-b183-3d0ddb14ab3b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83372024-11-27T18:41:57.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c92d783-f4e8-4efc-a5d8-5380829da26d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83382024-11-27T18:41:57.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c92d783-f4e8-4efc-a5d8-5380829da26d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83392024-11-27T18:41:57.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c92d783-f4e8-4efc-a5d8-5380829da26d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83402024-11-27T18:41:58.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 47a2a22b-0235-4c13-a300-fc3b507d3bd8 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
83412024-11-27T18:41:58.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 47a2a22b-0235-4c13-a300-fc3b507d3bd8 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
83422024-11-27T18:41:58.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 47a2a22b-0235-4c13-a300-fc3b507d3bd8 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
83432024-11-27T18:41:58.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 3ea9ef77-571f-423d-a076-88ab7a28801e roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
83442024-11-27T18:41:58.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 3ea9ef77-571f-423d-a076-88ab7a28801e resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
83452024-11-27T18:41:58.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 3ea9ef77-571f-423d-a076-88ab7a28801e response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
83462024-11-27T18:41:58.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc31640e-09a4-4bc0-ac65-78fb159e5a71 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83472024-11-27T18:41:58.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc31640e-09a4-4bc0-ac65-78fb159e5a71 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83482024-11-27T18:41:58.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc31640e-09a4-4bc0-ac65-78fb159e5a71 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83492024-11-27T18:41:59.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfeea98-620d-47ef-bbe4-225c4794a882 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83502024-11-27T18:41:59.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfeea98-620d-47ef-bbe4-225c4794a882 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83512024-11-27T18:41:59.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cbfeea98-620d-47ef-bbe4-225c4794a882 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83522024-11-27T18:42:01.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82309d52-a2e7-4e01-a269-daa8230ddbda roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83532024-11-27T18:42:01.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82309d52-a2e7-4e01-a269-daa8230ddbda resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83542024-11-27T18:42:01.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 82309d52-a2e7-4e01-a269-daa8230ddbda response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
83552024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
83562024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
83572024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83582024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83592024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
83602024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83612024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
83622024-11-27T18:42:01.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83632024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83642024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
83652024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83662024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83672024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
83682024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
83692024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83702024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83712024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83722024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83732024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
83742024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83752024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
83762024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83772024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
83782024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83792024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
83802024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83812024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83822024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
83832024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83842024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
83852024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
83862024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83872024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83882024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
83892024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83902024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83912024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83922024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83932024-11-27T18:42:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83942024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83952024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83962024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83972024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83982024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83992024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84002024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84012024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84022024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84032024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84042024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84052024-11-27T18:42:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84062024-11-27T18:42:01.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072024-11-27T18:42:01.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84082024-11-27T18:42:01.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84092024-11-27T18:42:01.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84102024-11-27T18:42:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84112024-11-27T18:42:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.164827ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84122024-11-27T18:42:01.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84132024-11-27T18:42:01.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84142024-11-27T18:42:01.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84152024-11-27T18:42:01.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84162024-11-27T18:42:01.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84172024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84182024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84192024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84202024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84212024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84222024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84232024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84242024-11-27T18:42:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84252024-11-27T18:42:01.400ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84262024-11-27T18:42:01.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84272024-11-27T18:42:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84282024-11-27T18:42:01.401ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84292024-11-27T18:42:01.401ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84302024-11-27T18:42:01.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84312024-11-27T18:42:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84322024-11-27T18:42:01.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 398617138 } })
84332024-11-27T18:42:01.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
84342024-11-27T18:42:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84352024-11-27T18:42:01.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84362024-11-27T18:42:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84372024-11-27T18:42:01.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 399976388 } })
84382024-11-27T18:42:01.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
84392024-11-27T18:42:01.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84402024-11-27T18:42:01.405ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84412024-11-27T18:42:01.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422024-11-27T18:42:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84432024-11-27T18:42:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84442024-11-27T18:42:01.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84452024-11-27T18:42:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84462024-11-27T18:42:01.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 403233226 } })
84472024-11-27T18:42:01.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84482024-11-27T18:42:01.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84492024-11-27T18:42:01.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
84502024-11-27T18:42:01.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84512024-11-27T18:42:01.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84522024-11-27T18:42:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84532024-11-27T18:42:01.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84542024-11-27T18:42:01.409ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84552024-11-27T18:42:01.409ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84562024-11-27T18:42:01.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84572024-11-27T18:42:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84582024-11-27T18:42:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84592024-11-27T18:42:01.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84602024-11-27T18:42:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84612024-11-27T18:42:01.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84622024-11-27T18:42:01.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84632024-11-27T18:42:01.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84642024-11-27T18:42:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84652024-11-27T18:42:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84662024-11-27T18:42:01.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84672024-11-27T18:42:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84682024-11-27T18:42:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
84692024-11-27T18:42:01.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84702024-11-27T18:42:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84712024-11-27T18:42:01.415ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84722024-11-27T18:42:01.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.665296ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84732024-11-27T18:42:01.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
84742024-11-27T18:42:01.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.84608ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
84752024-11-27T18:42:01.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.570501ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
84762024-11-27T18:42:01.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84772024-11-27T18:42:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84782024-11-27T18:42:01.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 49.402172ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84792024-11-27T18:42:01.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.478123ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84802024-11-27T18:42:01.443ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84812024-11-27T18:42:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84822024-11-27T18:42:01.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84832024-11-27T18:42:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84842024-11-27T18:42:01.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.699851ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84852024-11-27T18:42:01.445ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84862024-11-27T18:42:01.445ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84872024-11-27T18:42:01.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 53.167118ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84882024-11-27T18:42:01.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84892024-11-27T18:42:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84902024-11-27T18:42:01.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.526303ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
84912024-11-27T18:42:01.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84922024-11-27T18:42:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
84932024-11-27T18:42:01.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84942024-11-27T18:42:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84952024-11-27T18:42:01.453ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.423031ms iteration = 16 status = 0
84962024-11-27T18:42:01.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.397029ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84972024-11-27T18:42:01.469ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 77.202584ms iteration = 18 status = {"physical_disks_added":0}
84982024-11-27T18:42:01.480ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84992024-11-27T18:42:01.480ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85002024-11-27T18:42:01.480ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac88ebaa-d4af-4d1a-851a-6e2c21eabbe2", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85012024-11-27T18:42:01.480ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85022024-11-27T18:42:01.481ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
85032024-11-27T18:42:01.481ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85042024-11-27T18:42:01.481ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85052024-11-27T18:42:01.481ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0e87cee-ece3-43ef-a423-658d4090ca57", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85062024-11-27T18:42:01.481ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85072024-11-27T18:42:01.482ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85082024-11-27T18:42:01.488ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
85092024-11-27T18:42:01.488ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85102024-11-27T18:42:01.488ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87554cb6-f735-448e-9f3f-e6745df27899", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85112024-11-27T18:42:01.488ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85122024-11-27T18:42:01.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
85132024-11-27T18:42:01.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85142024-11-27T18:42:01.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85152024-11-27T18:42:01.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85162024-11-27T18:42:01.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85172024-11-27T18:42:01.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85182024-11-27T18:42:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85192024-11-27T18:42:01.565ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85202024-11-27T18:42:01.565ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b500d5-cdba-44ee-a90e-fbe69a3b25f4", "content-length": "1", "date": "Wed, 27 Nov 2024 18:42:00 GMT"} })
85212024-11-27T18:42:01.567ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85222024-11-27T18:42:01.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85232024-11-27T18:42:01.569ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 176.589367ms iteration = 16 status = {}
85242024-11-27T18:42:01.571ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85252024-11-27T18:42:01.571ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85262024-11-27T18:42:01.571ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ddefeec-5223-4f43-b136-cbeda56dc8d2", "content-length": "372", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85272024-11-27T18:42:01.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85282024-11-27T18:42:01.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85292024-11-27T18:42:01.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85302024-11-27T18:42:01.573ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.700319ms iteration = 16 status = null
85312024-11-27T18:42:01.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85322024-11-27T18:42:01.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85332024-11-27T18:42:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85342024-11-27T18:42:01.624ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85352024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85362024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d636b4c5-b7eb-41ab-93c2-0b40528e5590", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85372024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85382024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85392024-11-27T18:42:01.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85402024-11-27T18:42:01.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85412024-11-27T18:42:01.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85422024-11-27T18:42:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85432024-11-27T18:42:01.636ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85442024-11-27T18:42:01.636ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85452024-11-27T18:42:01.636ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62b5f2a7-f8bd-4d15-8924-2d6a05fe76b6", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85462024-11-27T18:42:01.636ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85472024-11-27T18:42:01.637ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e0dd044-f68e-4654-b1fc-6f4eaa775ac6", "content-length": "691", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85482024-11-27T18:42:01.637ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85492024-11-27T18:42:01.637ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85502024-11-27T18:42:01.637ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85512024-11-27T18:42:01.638ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.757393ms iteration = 16 status = {}
85522024-11-27T18:42:01.638ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 246.170429ms iteration = 16 status = {}
85532024-11-27T18:42:01.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85542024-11-27T18:42:01.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85552024-11-27T18:42:01.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
85562024-11-27T18:42:01.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85572024-11-27T18:42:01.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85582024-11-27T18:42:01.680ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85592024-11-27T18:42:01.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d28475-b404-4e8f-a048-c367dee2eccb", "content-length": "134", "date": "Wed, 27 Nov 2024 18:42:00 GMT"} })
85602024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85612024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
85622024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85632024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85642024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85652024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85662024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85672024-11-27T18:42:01.680ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85682024-11-27T18:42:01.681ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85692024-11-27T18:42:01.681ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85702024-11-27T18:42:01.681ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
85712024-11-27T18:42:01.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85722024-11-27T18:42:01.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85732024-11-27T18:42:01.688ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85742024-11-27T18:42:01.688ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d87a3da0-e637-4111-b4b6-b2ffcf42a5a3", "content-length": "2", "date": "Wed, 27 Nov 2024 18:42:00 GMT"} })
85752024-11-27T18:42:01.688ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85762024-11-27T18:42:01.688ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a927d52-fe51-4b42-8c52-29a13cd02acd", "content-length": "52", "date": "Wed, 27 Nov 2024 18:42:00 GMT"} })
85772024-11-27T18:42:01.688ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
85782024-11-27T18:42:01.688ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85792024-11-27T18:42:01.787ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7a5acc6-c6cb-4990-9d6e-f1326c4286c4", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85802024-11-27T18:42:01.787ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
85812024-11-27T18:42:01.787ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85822024-11-27T18:42:01.787ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a715da8a-1f5c-45d1-a007-ccbc5557ff21", "content-length": "682", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
85832024-11-27T18:42:01.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85842024-11-27T18:42:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85852024-11-27T18:42:01.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85862024-11-27T18:42:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85872024-11-27T18:42:01.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85882024-11-27T18:42:01.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85892024-11-27T18:42:01.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85902024-11-27T18:42:01.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85912024-11-27T18:42:01.804ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 411.707552ms iteration = 16 status = {}
85922024-11-27T18:42:02.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b1284d9-656e-444c-924a-0a4d38897e5b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
85932024-11-27T18:42:02.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b1284d9-656e-444c-924a-0a4d38897e5b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
85942024-11-27T18:42:02.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0b1284d9-656e-444c-924a-0a4d38897e5b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
85952024-11-27T18:42:02.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a7cde78-b58c-470d-82ca-104509cb461f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
85962024-11-27T18:42:02.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a7cde78-b58c-470d-82ca-104509cb461f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
85972024-11-27T18:42:02.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = 5a7cde78-b58c-470d-82ca-104509cb461f response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
85982024-11-27T18:42:03.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 489faf05-1786-465f-a47c-6ef77ed37ce5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
85992024-11-27T18:42:03.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 489faf05-1786-465f-a47c-6ef77ed37ce5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86002024-11-27T18:42:03.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 489faf05-1786-465f-a47c-6ef77ed37ce5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86012024-11-27T18:42:03.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = d25dba53-e582-4b1c-b781-10f9dd50c68f response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
86022024-11-27T18:42:04.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 978171d9-4f16-4494-847b-5215872a7eb1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86032024-11-27T18:42:04.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 978171d9-4f16-4494-847b-5215872a7eb1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86042024-11-27T18:42:04.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 978171d9-4f16-4494-847b-5215872a7eb1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86052024-11-27T18:42:05.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b36d2283-e384-47a1-9d01-20f0b82606cb roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86062024-11-27T18:42:05.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b36d2283-e384-47a1-9d01-20f0b82606cb resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86072024-11-27T18:42:05.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b36d2283-e384-47a1-9d01-20f0b82606cb response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86082024-11-27T18:42:06.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a0379332-6742-4cb9-9ce7-32cc5f260ae3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86092024-11-27T18:42:06.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a0379332-6742-4cb9-9ce7-32cc5f260ae3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86102024-11-27T18:42:06.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a0379332-6742-4cb9-9ce7-32cc5f260ae3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86112024-11-27T18:42:07.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9ddf93c-f1a2-45ed-88cd-7d7d36afa0c5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86122024-11-27T18:42:07.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9ddf93c-f1a2-45ed-88cd-7d7d36afa0c5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86132024-11-27T18:42:07.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b9ddf93c-f1a2-45ed-88cd-7d7d36afa0c5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86142024-11-27T18:42:08.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce7e3c39-7d5f-4c9b-bdb7-f5224bda4057 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86152024-11-27T18:42:08.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce7e3c39-7d5f-4c9b-bdb7-f5224bda4057 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86162024-11-27T18:42:08.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ce7e3c39-7d5f-4c9b-bdb7-f5224bda4057 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86172024-11-27T18:42:09.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 855aca33-e021-45fc-9c19-aefbe6cd06fa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86182024-11-27T18:42:09.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 855aca33-e021-45fc-9c19-aefbe6cd06fa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86192024-11-27T18:42:09.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 855aca33-e021-45fc-9c19-aefbe6cd06fa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86202024-11-27T18:42:10.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 300b7817-88b2-4129-9677-fa20592eb475 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86212024-11-27T18:42:10.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 300b7817-88b2-4129-9677-fa20592eb475 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86222024-11-27T18:42:10.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 300b7817-88b2-4129-9677-fa20592eb475 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86232024-11-27T18:42:11.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed115bd9-0f69-4e64-abbf-6007cb2f3b08 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86242024-11-27T18:42:11.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed115bd9-0f69-4e64-abbf-6007cb2f3b08 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86252024-11-27T18:42:11.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ed115bd9-0f69-4e64-abbf-6007cb2f3b08 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86262024-11-27T18:42:11.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
86272024-11-27T18:42:11.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
86282024-11-27T18:42:11.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86292024-11-27T18:42:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86302024-11-27T18:42:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86312024-11-27T18:42:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86322024-11-27T18:42:11.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86332024-11-27T18:42:11.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86342024-11-27T18:42:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86352024-11-27T18:42:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.201622ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86362024-11-27T18:42:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86372024-11-27T18:42:11.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86382024-11-27T18:42:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86392024-11-27T18:42:11.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86402024-11-27T18:42:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86412024-11-27T18:42:11.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86422024-11-27T18:42:11.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
86432024-11-27T18:42:11.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86442024-11-27T18:42:11.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86452024-11-27T18:42:11.409ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
86462024-11-27T18:42:11.409ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.131154ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
86472024-11-27T18:42:12.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb88abfc-f021-434a-9972-3041a4e775b0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86482024-11-27T18:42:12.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb88abfc-f021-434a-9972-3041a4e775b0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86492024-11-27T18:42:12.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb88abfc-f021-434a-9972-3041a4e775b0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86502024-11-27T18:42:13.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3805ba2b-e311-4dd0-ad81-9c13b92a3d48 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86512024-11-27T18:42:13.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3805ba2b-e311-4dd0-ad81-9c13b92a3d48 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86522024-11-27T18:42:13.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3805ba2b-e311-4dd0-ad81-9c13b92a3d48 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86532024-11-27T18:42:13.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 789 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 10b1eb8a-c060-420f-8c4c-4bc023c9c9dc response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
86542024-11-27T18:42:14.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b88158f2-9026-4b2e-b66b-669ea90031b3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86552024-11-27T18:42:14.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b88158f2-9026-4b2e-b66b-669ea90031b3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86562024-11-27T18:42:14.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b88158f2-9026-4b2e-b66b-669ea90031b3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86572024-11-27T18:42:15.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b1d6b51-2fb0-4e0b-a464-b60a55bafdb9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86582024-11-27T18:42:15.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b1d6b51-2fb0-4e0b-a464-b60a55bafdb9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86592024-11-27T18:42:15.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5b1d6b51-2fb0-4e0b-a464-b60a55bafdb9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86602024-11-27T18:42:16.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34772880-b71c-49ac-aa81-b18a6260346d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86612024-11-27T18:42:16.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34772880-b71c-49ac-aa81-b18a6260346d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86622024-11-27T18:42:16.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 34772880-b71c-49ac-aa81-b18a6260346d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86632024-11-27T18:42:17.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a54a4772-b98a-488a-91c2-76827659999e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86642024-11-27T18:42:17.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a54a4772-b98a-488a-91c2-76827659999e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86652024-11-27T18:42:17.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a54a4772-b98a-488a-91c2-76827659999e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86662024-11-27T18:42:18.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 92f9b7de-554e-4769-9c00-2e031025bd15 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86672024-11-27T18:42:18.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 92f9b7de-554e-4769-9c00-2e031025bd15 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86682024-11-27T18:42:18.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 92f9b7de-554e-4769-9c00-2e031025bd15 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86692024-11-27T18:42:19.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e1562b5-d6c1-40de-8dfd-95048ea589b0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86702024-11-27T18:42:19.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e1562b5-d6c1-40de-8dfd-95048ea589b0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86712024-11-27T18:42:19.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0e1562b5-d6c1-40de-8dfd-95048ea589b0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86722024-11-27T18:42:20.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 344d8857-71ad-4eac-92e4-0150da0fa5f2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86732024-11-27T18:42:20.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 344d8857-71ad-4eac-92e4-0150da0fa5f2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86742024-11-27T18:42:20.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 344d8857-71ad-4eac-92e4-0150da0fa5f2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86752024-11-27T18:42:21.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
86762024-11-27T18:42:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86772024-11-27T18:42:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86782024-11-27T18:42:21.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
86792024-11-27T18:42:21.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86802024-11-27T18:42:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86812024-11-27T18:42:21.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86822024-11-27T18:42:21.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86832024-11-27T18:42:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86842024-11-27T18:42:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86852024-11-27T18:42:21.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86862024-11-27T18:42:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86872024-11-27T18:42:21.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.528312ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86882024-11-27T18:42:21.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86892024-11-27T18:42:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86902024-11-27T18:42:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912024-11-27T18:42:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
86922024-11-27T18:42:21.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86932024-11-27T18:42:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86942024-11-27T18:42:21.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
86952024-11-27T18:42:21.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.452133ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
86962024-11-27T18:42:21.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3383aa6d-38fa-4520-b780-510629e5c8b3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86972024-11-27T18:42:21.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3383aa6d-38fa-4520-b780-510629e5c8b3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86982024-11-27T18:42:21.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3383aa6d-38fa-4520-b780-510629e5c8b3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
86992024-11-27T18:42:22.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3c76255c-bfcf-4018-af30-2cb3cdf50c37 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87002024-11-27T18:42:22.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3c76255c-bfcf-4018-af30-2cb3cdf50c37 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87012024-11-27T18:42:22.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3c76255c-bfcf-4018-af30-2cb3cdf50c37 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87022024-11-27T18:42:23.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 424b8053-f100-412c-b58f-49323744a934 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87032024-11-27T18:42:23.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 424b8053-f100-412c-b58f-49323744a934 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87042024-11-27T18:42:23.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 424b8053-f100-412c-b58f-49323744a934 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87052024-11-27T18:42:23.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 604 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 6557a995-e06b-45ab-8f78-20264ddb2e40 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
87062024-11-27T18:42:24.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 09c81a01-6d8e-4526-bbaa-2f7eea2e1e11 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87072024-11-27T18:42:24.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 09c81a01-6d8e-4526-bbaa-2f7eea2e1e11 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87082024-11-27T18:42:24.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 09c81a01-6d8e-4526-bbaa-2f7eea2e1e11 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87092024-11-27T18:42:25.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65fd0701-d567-4f3f-bc77-f537e7d4ba89 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87102024-11-27T18:42:25.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65fd0701-d567-4f3f-bc77-f537e7d4ba89 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87112024-11-27T18:42:25.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 65fd0701-d567-4f3f-bc77-f537e7d4ba89 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87122024-11-27T18:42:26.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c5d1642-3c3e-4687-b0b3-a4416299b04f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87132024-11-27T18:42:26.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c5d1642-3c3e-4687-b0b3-a4416299b04f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87142024-11-27T18:42:26.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c5d1642-3c3e-4687-b0b3-a4416299b04f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87152024-11-27T18:42:27.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2f517cf7-c554-4544-ad46-7a012db2b346 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87162024-11-27T18:42:27.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2f517cf7-c554-4544-ad46-7a012db2b346 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87172024-11-27T18:42:27.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2f517cf7-c554-4544-ad46-7a012db2b346 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87182024-11-27T18:42:28.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 404b176d-5d35-4bd6-aa64-38dfd600d6d5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87192024-11-27T18:42:28.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 404b176d-5d35-4bd6-aa64-38dfd600d6d5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87202024-11-27T18:42:28.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 404b176d-5d35-4bd6-aa64-38dfd600d6d5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87212024-11-27T18:42:29.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7e3f03a-2ba4-4a7b-ba69-0fd146f2da41 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87222024-11-27T18:42:29.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7e3f03a-2ba4-4a7b-ba69-0fd146f2da41 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87232024-11-27T18:42:29.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7e3f03a-2ba4-4a7b-ba69-0fd146f2da41 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87242024-11-27T18:42:30.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7f56a31-9271-47ce-8455-12db4ff850fd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87252024-11-27T18:42:30.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7f56a31-9271-47ce-8455-12db4ff850fd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87262024-11-27T18:42:30.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7f56a31-9271-47ce-8455-12db4ff850fd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
87272024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
87282024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
87292024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87302024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
87312024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87322024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
87332024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
87342024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87352024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
87362024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87372024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87382024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87392024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87402024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87412024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
87422024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87432024-11-27T18:42:31.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
87442024-11-27T18:42:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
87452024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.331\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
87462024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87472024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
87482024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
87492024-11-27T18:42:31.393ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87502024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87512024-11-27T18:42:31.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87522024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87532024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
87542024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87552024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87562024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87572024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
87582024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
87592024-11-27T18:42:31.393ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:32:31.392895943 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87602024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
87612024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87622024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87632024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87642024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
87652024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87662024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87672024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
87682024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87692024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87702024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
87712024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87722024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
87732024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87742024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
87752024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87762024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87772024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87782024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87792024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87802024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
87812024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87822024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87832024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87842024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87852024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
87862024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
87872024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87882024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
87892024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87902024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87912024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87922024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87932024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87942024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87952024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87962024-11-27T18:42:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 390015440 } })
87972024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87982024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87992024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88002024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88012024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88022024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88032024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88042024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88052024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88062024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88072024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88082024-11-27T18:42:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 390159432 } })
88092024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88102024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88112024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88122024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88132024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88142024-11-27T18:42:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88152024-11-27T18:42:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
88162024-11-27T18:42:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.417741ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
88172024-11-27T18:42:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
88182024-11-27T18:42:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.042965ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
88192024-11-27T18:42:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.063395ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88202024-11-27T18:42:31.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88212024-11-27T18:42:31.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88222024-11-27T18:42:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88232024-11-27T18:42:31.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88242024-11-27T18:42:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88252024-11-27T18:42:31.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88262024-11-27T18:42:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88272024-11-27T18:42:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88282024-11-27T18:42:31.399ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292024-11-27T18:42:31.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88302024-11-27T18:42:31.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312024-11-27T18:42:31.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88322024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88332024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88342024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88352024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88362024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88372024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88382024-11-27T18:42:31.402ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:32:31.392895943 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88392024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.848706ms iteration = 9 status = {"expiration":"2024-11-27T18:32:31.392895943Z","pruned":[]}
88402024-11-27T18:42:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88412024-11-27T18:42:31.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88422024-11-27T18:42:31.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88432024-11-27T18:42:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88442024-11-27T18:42:31.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88452024-11-27T18:42:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88462024-11-27T18:42:31.405ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.285392ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
88472024-11-27T18:42:31.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 402997942 } })
88482024-11-27T18:42:31.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 403145254 } })
88492024-11-27T18:42:31.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88502024-11-27T18:42:31.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88512024-11-27T18:42:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88522024-11-27T18:42:31.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88532024-11-27T18:42:31.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542024-11-27T18:42:31.407ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88552024-11-27T18:42:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88562024-11-27T18:42:31.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-11-27T18:42:31.409ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88582024-11-27T18:42:31.409ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88592024-11-27T18:42:31.409ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.046348ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88602024-11-27T18:42:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88612024-11-27T18:42:31.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88622024-11-27T18:42:31.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88632024-11-27T18:42:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88642024-11-27T18:42:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88652024-11-27T18:42:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88662024-11-27T18:42:31.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88672024-11-27T18:42:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88682024-11-27T18:42:31.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.906521ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88692024-11-27T18:42:31.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88702024-11-27T18:42:31.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88712024-11-27T18:42:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88722024-11-27T18:42:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88732024-11-27T18:42:31.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88742024-11-27T18:42:31.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88752024-11-27T18:42:31.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762024-11-27T18:42:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88772024-11-27T18:42:31.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88782024-11-27T18:42:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88792024-11-27T18:42:31.426ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88802024-11-27T18:42:31.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88812024-11-27T18:42:31.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 423862101 } })
88822024-11-27T18:42:31.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
88832024-11-27T18:42:31.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.575332ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
88842024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88852024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88862024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88872024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88882024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88892024-11-27T18:42:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88902024-11-27T18:42:31.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88912024-11-27T18:42:31.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88922024-11-27T18:42:31.434ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88932024-11-27T18:42:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88942024-11-27T18:42:31.436ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.083894ms iteration = 19 status = {"physical_disks_added":0}
88952024-11-27T18:42:31.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88962024-11-27T18:42:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88972024-11-27T18:42:31.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.978536ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
88982024-11-27T18:42:31.442ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88992024-11-27T18:42:31.442ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89002024-11-27T18:42:31.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89012024-11-27T18:42:31.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89022024-11-27T18:42:31.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89032024-11-27T18:42:31.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89042024-11-27T18:42:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89052024-11-27T18:42:31.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89062024-11-27T18:42:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89072024-11-27T18:42:31.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89082024-11-27T18:42:31.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89092024-11-27T18:42:31.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89102024-11-27T18:42:31.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89112024-11-27T18:42:31.450ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89122024-11-27T18:42:31.450ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.231479ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89132024-11-27T18:42:31.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142024-11-27T18:42:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89152024-11-27T18:42:31.452ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89162024-11-27T18:42:31.452ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89172024-11-27T18:42:31.452ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89182024-11-27T18:42:31.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89192024-11-27T18:42:31.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89202024-11-27T18:42:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89212024-11-27T18:42:31.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89222024-11-27T18:42:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89232024-11-27T18:42:31.456ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89242024-11-27T18:42:31.456ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
89252024-11-27T18:42:31.456ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 63.280558ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89262024-11-27T18:42:31.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.369734ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89272024-11-27T18:42:31.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.254867ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89282024-11-27T18:42:31.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89292024-11-27T18:42:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89302024-11-27T18:42:31.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89312024-11-27T18:42:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89322024-11-27T18:42:31.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89332024-11-27T18:42:31.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89342024-11-27T18:42:31.490ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89352024-11-27T18:42:31.490ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89362024-11-27T18:42:31.490ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89372024-11-27T18:42:31.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89382024-11-27T18:42:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89392024-11-27T18:42:31.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89402024-11-27T18:42:31.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
89412024-11-27T18:42:31.588ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89422024-11-27T18:42:31.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89432024-11-27T18:42:31.588ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89442024-11-27T18:42:31.588ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43bfed09-1e5a-411d-97d1-af53a0ba8b16", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
89452024-11-27T18:42:31.588ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89462024-11-27T18:42:31.590ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de61df7d-42b5-4719-a1ae-41aed375f491", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
89472024-11-27T18:42:31.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89482024-11-27T18:42:31.590ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
89492024-11-27T18:42:31.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89502024-11-27T18:42:31.621ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89512024-11-27T18:42:31.622ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1bd06fa-b79c-429e-98be-8d5604d67f69", "content-length": "691", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
89522024-11-27T18:42:31.622ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89532024-11-27T18:42:31.622ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89542024-11-27T18:42:31.622ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89552024-11-27T18:42:31.626ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 233.618423ms iteration = 17 status = {}
89562024-11-27T18:42:31.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89572024-11-27T18:42:31.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89582024-11-27T18:42:31.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89592024-11-27T18:42:31.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89602024-11-27T18:42:31.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89612024-11-27T18:42:31.629ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89622024-11-27T18:42:31.629ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89632024-11-27T18:42:31.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89642024-11-27T18:42:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89652024-11-27T18:42:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89662024-11-27T18:42:31.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89672024-11-27T18:42:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89682024-11-27T18:42:31.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692024-11-27T18:42:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
89702024-11-27T18:42:31.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89712024-11-27T18:42:31.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89722024-11-27T18:42:31.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e66a8f9-52df-4f81-bd69-5df73cf5a015 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
89732024-11-27T18:42:31.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e66a8f9-52df-4f81-bd69-5df73cf5a015 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
89742024-11-27T18:42:31.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3e66a8f9-52df-4f81-bd69-5df73cf5a015 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
89752024-11-27T18:42:31.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89762024-11-27T18:42:31.667ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
89772024-11-27T18:42:31.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 274.798923ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
89782024-11-27T18:42:31.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89792024-11-27T18:42:31.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89802024-11-27T18:42:31.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89812024-11-27T18:42:31.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89822024-11-27T18:42:31.676ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89832024-11-27T18:42:31.683ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89842024-11-27T18:42:31.683ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89852024-11-27T18:42:31.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 290.616918ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89862024-11-27T18:42:31.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89872024-11-27T18:42:31.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 292.651648ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89882024-11-27T18:42:31.686ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89892024-11-27T18:42:31.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89902024-11-27T18:42:31.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89912024-11-27T18:42:31.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922024-11-27T18:42:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89932024-11-27T18:42:31.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89942024-11-27T18:42:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89952024-11-27T18:42:31.707ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89962024-11-27T18:42:31.707ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89972024-11-27T18:42:31.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89982024-11-27T18:42:31.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89992024-11-27T18:42:31.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002024-11-27T18:42:31.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90012024-11-27T18:42:31.718ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90022024-11-27T18:42:31.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b4ed691-9026-488a-b14b-d18a5b613961", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90032024-11-27T18:42:31.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90042024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
90052024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90062024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90072024-11-27T18:42:31.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90082024-11-27T18:42:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 340.01194ms iteration = 17 status = 0
90092024-11-27T18:42:31.742ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
90102024-11-27T18:42:31.742ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 350.15668ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90112024-11-27T18:42:31.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90122024-11-27T18:42:31.752ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90132024-11-27T18:42:31.752ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
90142024-11-27T18:42:31.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90152024-11-27T18:42:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90162024-11-27T18:42:31.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90172024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90182024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90192024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90202024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90212024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90222024-11-27T18:42:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90232024-11-27T18:42:31.759ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90242024-11-27T18:42:31.759ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90252024-11-27T18:42:31.759ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
90262024-11-27T18:42:31.759ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 366.317289ms iteration = 9 status = {"generation":1}
90272024-11-27T18:42:31.763ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 370.893187ms iteration = 17 status = {}
90282024-11-27T18:42:31.770ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90292024-11-27T18:42:31.770ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 378.029492ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90302024-11-27T18:42:31.835ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90312024-11-27T18:42:31.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bc85f2ea-49a3-47d1-9c64-d1a5ce4dae99", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90322024-11-27T18:42:31.835ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90332024-11-27T18:42:31.837ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dfd858af-572b-4900-b537-eec35a3e34c6", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90342024-11-27T18:42:31.838ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90352024-11-27T18:42:31.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "87c6901e-ac23-4186-9fd9-7d8f145c8244", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90362024-11-27T18:42:31.839ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90372024-11-27T18:42:31.841ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
90382024-11-27T18:42:31.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 448.226113ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90392024-11-27T18:42:31.874ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90402024-11-27T18:42:31.875ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e54308b-f73f-4b46-b0a9-d67260f6f094", "content-length": "1", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90412024-11-27T18:42:31.876ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90422024-11-27T18:42:31.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90432024-11-27T18:42:31.913ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90442024-11-27T18:42:31.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b88a1bf4-3e49-4cdc-969b-46d5689007ba", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90452024-11-27T18:42:31.913ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90462024-11-27T18:42:31.914ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8dd7bd68-a6d1-4ed3-8657-1d61f1c88e3a", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90472024-11-27T18:42:31.914ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90482024-11-27T18:42:31.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90492024-11-27T18:42:31.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 524.407653ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90502024-11-27T18:42:31.923ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90512024-11-27T18:42:31.923ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90522024-11-27T18:42:31.923ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e7a6a29-9e08-4626-8f9b-f6d53b941b92", "content-length": "372", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90532024-11-27T18:42:31.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90542024-11-27T18:42:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90552024-11-27T18:42:31.925ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
90562024-11-27T18:42:31.925ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90572024-11-27T18:42:31.925ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
90582024-11-27T18:42:31.925ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 532.666665ms iteration = 9 status = {"generation":2}
90592024-11-27T18:42:31.926ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 532.951249ms iteration = 17 status = null
90602024-11-27T18:42:31.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90612024-11-27T18:42:31.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90622024-11-27T18:42:31.941ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
90632024-11-27T18:42:31.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90642024-11-27T18:42:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90652024-11-27T18:42:31.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90662024-11-27T18:42:31.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d83b76a-2817-400a-bc74-97b5095e8b6b", "content-length": "134", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90672024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90682024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
90692024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90702024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90712024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90722024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90732024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90742024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90752024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90762024-11-27T18:42:31.956ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90772024-11-27T18:42:31.957ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
90782024-11-27T18:42:31.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90792024-11-27T18:42:31.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90802024-11-27T18:42:31.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90812024-11-27T18:42:31.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "32d34329-1fd0-4a69-a195-418659ed0e3d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90822024-11-27T18:42:31.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90832024-11-27T18:42:31.959ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d2eb4a9-02f0-4c08-a078-191239d87016", "content-length": "52", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90842024-11-27T18:42:31.959ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
90852024-11-27T18:42:31.959ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90862024-11-27T18:42:31.973ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90872024-11-27T18:42:31.973ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90882024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "121c74b8-6b3f-4b4c-b2c9-8eaee405f3ef", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
90892024-11-27T18:42:32.097ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
90902024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90912024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1026568d-c700-4952-a504-27e141f0f23e", "content-length": "682", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
90922024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90932024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90942024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7680b194-a8b8-48a4-bf9e-7ccf3fd52ab9", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
90952024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90962024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90972024-11-27T18:42:32.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90982024-11-27T18:42:32.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90992024-11-27T18:42:32.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91002024-11-27T18:42:32.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91012024-11-27T18:42:32.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91022024-11-27T18:42:32.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91032024-11-27T18:42:32.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91042024-11-27T18:42:32.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91052024-11-27T18:42:32.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91062024-11-27T18:42:32.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91072024-11-27T18:42:32.110ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91082024-11-27T18:42:32.110ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91092024-11-27T18:42:32.110ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5a3a3cdb-ee7e-4453-8f3b-14f66d485ea8", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
91102024-11-27T18:42:32.112ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 719.553745ms iteration = 17 status = {}
91112024-11-27T18:42:32.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 732.772592ms iteration = 17 status = {}
91122024-11-27T18:42:32.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f92bc131-5330-422f-87ee-327597c3ffad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
91132024-11-27T18:42:32.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f92bc131-5330-422f-87ee-327597c3ffad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
91142024-11-27T18:42:32.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = f92bc131-5330-422f-87ee-327597c3ffad response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
91152024-11-27T18:42:32.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc3ad959-1c5e-45f1-a9da-4afc10040edf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91162024-11-27T18:42:32.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc3ad959-1c5e-45f1-a9da-4afc10040edf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91172024-11-27T18:42:32.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc3ad959-1c5e-45f1-a9da-4afc10040edf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91182024-11-27T18:42:33.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 644 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 1c05be7b-85f7-48df-8297-b3cf6538527b response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
91192024-11-27T18:42:33.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea894e63-e36f-4b56-a3db-053d6882bf29 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91202024-11-27T18:42:33.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea894e63-e36f-4b56-a3db-053d6882bf29 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91212024-11-27T18:42:33.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea894e63-e36f-4b56-a3db-053d6882bf29 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91222024-11-27T18:42:34.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7627fb47-639c-419a-8405-5007c7804d3c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91232024-11-27T18:42:34.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7627fb47-639c-419a-8405-5007c7804d3c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91242024-11-27T18:42:34.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7627fb47-639c-419a-8405-5007c7804d3c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91252024-11-27T18:42:35.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0807a48f-b292-46be-b74b-72ccf57f4807 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91262024-11-27T18:42:35.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0807a48f-b292-46be-b74b-72ccf57f4807 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91272024-11-27T18:42:35.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0807a48f-b292-46be-b74b-72ccf57f4807 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91282024-11-27T18:42:36.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb8d3a34-f021-4c5b-ac4d-003089bba75d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91292024-11-27T18:42:36.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb8d3a34-f021-4c5b-ac4d-003089bba75d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91302024-11-27T18:42:36.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb8d3a34-f021-4c5b-ac4d-003089bba75d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91312024-11-27T18:42:37.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 523eab2c-93d2-44da-ab49-1d2908d200b3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91322024-11-27T18:42:37.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 523eab2c-93d2-44da-ab49-1d2908d200b3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91332024-11-27T18:42:37.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 523eab2c-93d2-44da-ab49-1d2908d200b3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91342024-11-27T18:42:38.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51bc9d88-efbe-4de3-b761-cec176fef3ef roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91352024-11-27T18:42:38.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51bc9d88-efbe-4de3-b761-cec176fef3ef resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91362024-11-27T18:42:38.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 51bc9d88-efbe-4de3-b761-cec176fef3ef response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91372024-11-27T18:42:39.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56b07cda-cf13-466d-ac28-f7429975377b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91382024-11-27T18:42:39.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56b07cda-cf13-466d-ac28-f7429975377b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91392024-11-27T18:42:39.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 56b07cda-cf13-466d-ac28-f7429975377b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91402024-11-27T18:42:40.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75928e11-57f3-4dd3-8214-18c6419305a7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91412024-11-27T18:42:40.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75928e11-57f3-4dd3-8214-18c6419305a7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91422024-11-27T18:42:40.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 75928e11-57f3-4dd3-8214-18c6419305a7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91432024-11-27T18:42:41.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
91442024-11-27T18:42:41.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91452024-11-27T18:42:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91462024-11-27T18:42:41.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
91472024-11-27T18:42:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91482024-11-27T18:42:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91492024-11-27T18:42:41.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91502024-11-27T18:42:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91512024-11-27T18:42:41.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91522024-11-27T18:42:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91532024-11-27T18:42:41.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91542024-11-27T18:42:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91552024-11-27T18:42:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91562024-11-27T18:42:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
91572024-11-27T18:42:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91582024-11-27T18:42:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91592024-11-27T18:42:41.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
91602024-11-27T18:42:41.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.982652ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
91612024-11-27T18:42:41.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91622024-11-27T18:42:41.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91632024-11-27T18:42:41.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.906093ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91642024-11-27T18:42:41.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f92186a0-a7e9-4fec-a32d-41d5acbf1864 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91652024-11-27T18:42:41.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f92186a0-a7e9-4fec-a32d-41d5acbf1864 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91662024-11-27T18:42:41.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f92186a0-a7e9-4fec-a32d-41d5acbf1864 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91672024-11-27T18:42:42.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f82f3fe5-3942-4b7a-8d9b-0aacb410b039 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91682024-11-27T18:42:42.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f82f3fe5-3942-4b7a-8d9b-0aacb410b039 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91692024-11-27T18:42:42.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f82f3fe5-3942-4b7a-8d9b-0aacb410b039 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91702024-11-27T18:42:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c71ad500-a682-4254-bdbe-a1c3e5b650dd roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
91712024-11-27T18:42:43.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c71ad500-a682-4254-bdbe-a1c3e5b650dd resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
91722024-11-27T18:42:43.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c71ad500-a682-4254-bdbe-a1c3e5b650dd response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
91732024-11-27T18:42:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c297fc4c-d827-4646-b59c-401bb778f11c roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
91742024-11-27T18:42:43.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c297fc4c-d827-4646-b59c-401bb778f11c resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
91752024-11-27T18:42:43.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = c297fc4c-d827-4646-b59c-401bb778f11c response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
91762024-11-27T18:42:43.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = c62d1d1d-1b13-409f-afa2-4d6da2bfc3e1 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
91772024-11-27T18:42:43.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e0b7596-5b78-4fc3-82ab-f1e2a2f8da1d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91782024-11-27T18:42:43.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e0b7596-5b78-4fc3-82ab-f1e2a2f8da1d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91792024-11-27T18:42:43.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4e0b7596-5b78-4fc3-82ab-f1e2a2f8da1d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91802024-11-27T18:42:44.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1dca75f-c509-4ef3-836e-9aae1e2760ca roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91812024-11-27T18:42:44.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1dca75f-c509-4ef3-836e-9aae1e2760ca resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91822024-11-27T18:42:44.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1dca75f-c509-4ef3-836e-9aae1e2760ca response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91832024-11-27T18:42:45.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30193599-f7aa-483c-a902-b1bc069ec0cd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91842024-11-27T18:42:45.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30193599-f7aa-483c-a902-b1bc069ec0cd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91852024-11-27T18:42:45.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30193599-f7aa-483c-a902-b1bc069ec0cd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91862024-11-27T18:42:46.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4a8a077-44bc-4df5-8681-57bcbfec4e35 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91872024-11-27T18:42:46.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4a8a077-44bc-4df5-8681-57bcbfec4e35 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91882024-11-27T18:42:46.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4a8a077-44bc-4df5-8681-57bcbfec4e35 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91892024-11-27T18:42:48.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7b9cd2e-c5ea-4fd9-9d36-b1a93908fc4b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91902024-11-27T18:42:48.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7b9cd2e-c5ea-4fd9-9d36-b1a93908fc4b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91912024-11-27T18:42:48.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f7b9cd2e-c5ea-4fd9-9d36-b1a93908fc4b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91922024-11-27T18:42:49.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e700acd5-0f73-4853-8172-38f6f6e3c3c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91932024-11-27T18:42:49.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e700acd5-0f73-4853-8172-38f6f6e3c3c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91942024-11-27T18:42:49.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e700acd5-0f73-4853-8172-38f6f6e3c3c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91952024-11-27T18:42:50.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4239747-04fd-42b4-831e-a9711b97b0c6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91962024-11-27T18:42:50.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4239747-04fd-42b4-831e-a9711b97b0c6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91972024-11-27T18:42:50.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c4239747-04fd-42b4-831e-a9711b97b0c6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91982024-11-27T18:42:51.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977c3f8a-e2bd-4e18-9852-22705602e34f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
91992024-11-27T18:42:51.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977c3f8a-e2bd-4e18-9852-22705602e34f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92002024-11-27T18:42:51.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 977c3f8a-e2bd-4e18-9852-22705602e34f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92012024-11-27T18:42:51.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
92022024-11-27T18:42:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92032024-11-27T18:42:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92042024-11-27T18:42:51.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
92052024-11-27T18:42:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92062024-11-27T18:42:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92072024-11-27T18:42:51.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92082024-11-27T18:42:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92092024-11-27T18:42:51.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92102024-11-27T18:42:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92112024-11-27T18:42:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92122024-11-27T18:42:51.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92132024-11-27T18:42:51.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92142024-11-27T18:42:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92152024-11-27T18:42:51.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92162024-11-27T18:42:51.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
92172024-11-27T18:42:51.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92182024-11-27T18:42:51.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92192024-11-27T18:42:51.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
92202024-11-27T18:42:51.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.92485ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
92212024-11-27T18:42:51.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.072155ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92222024-11-27T18:42:52.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bfd5cb1d-acb3-4b99-b6dd-88ee48c3dd29 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92232024-11-27T18:42:52.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bfd5cb1d-acb3-4b99-b6dd-88ee48c3dd29 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92242024-11-27T18:42:52.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bfd5cb1d-acb3-4b99-b6dd-88ee48c3dd29 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92252024-11-27T18:42:53.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a79c461f-7c3f-4869-bd85-25598fabb59f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92262024-11-27T18:42:53.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a79c461f-7c3f-4869-bd85-25598fabb59f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92272024-11-27T18:42:53.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a79c461f-7c3f-4869-bd85-25598fabb59f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92282024-11-27T18:42:53.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 090a0a00-94a7-44ca-a36f-bbcc184a43d8 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
92292024-11-27T18:42:54.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb81a918-2efa-4bb8-bcbc-0423e9fe60bd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92302024-11-27T18:42:54.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb81a918-2efa-4bb8-bcbc-0423e9fe60bd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92312024-11-27T18:42:54.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb81a918-2efa-4bb8-bcbc-0423e9fe60bd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92322024-11-27T18:42:55.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c575c357-57c3-46bb-ba3b-4d72b4104449 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92332024-11-27T18:42:55.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c575c357-57c3-46bb-ba3b-4d72b4104449 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92342024-11-27T18:42:55.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c575c357-57c3-46bb-ba3b-4d72b4104449 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92352024-11-27T18:42:56.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7612da7a-95a9-455d-a1e5-f709831c9b63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92362024-11-27T18:42:56.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7612da7a-95a9-455d-a1e5-f709831c9b63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92372024-11-27T18:42:56.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7612da7a-95a9-455d-a1e5-f709831c9b63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92382024-11-27T18:42:57.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3f82afc-9fa2-4bf0-98d5-cbd05bb29b1d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92392024-11-27T18:42:57.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3f82afc-9fa2-4bf0-98d5-cbd05bb29b1d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92402024-11-27T18:42:57.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b3f82afc-9fa2-4bf0-98d5-cbd05bb29b1d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92412024-11-27T18:42:58.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0157d7de-620b-4fc2-9732-4c31807e6f3d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92422024-11-27T18:42:58.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0157d7de-620b-4fc2-9732-4c31807e6f3d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92432024-11-27T18:42:58.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0157d7de-620b-4fc2-9732-4c31807e6f3d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92442024-11-27T18:42:58.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 1d0a06c1-c71e-4e86-85a7-1f021b659280 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
92452024-11-27T18:42:58.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 1d0a06c1-c71e-4e86-85a7-1f021b659280 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
92462024-11-27T18:42:58.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 1d0a06c1-c71e-4e86-85a7-1f021b659280 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
92472024-11-27T18:42:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 23420217-0df1-4fbb-a29c-93ca528a8040 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
92482024-11-27T18:42:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 23420217-0df1-4fbb-a29c-93ca528a8040 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
92492024-11-27T18:42:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44085 req_id = 23420217-0df1-4fbb-a29c-93ca528a8040 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
92502024-11-27T18:42:59.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ab5410c-bb14-4ff0-953a-0a1fea7441b8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92512024-11-27T18:42:59.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ab5410c-bb14-4ff0-953a-0a1fea7441b8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92522024-11-27T18:42:59.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9ab5410c-bb14-4ff0-953a-0a1fea7441b8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92532024-11-27T18:43:00.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 425d8181-741e-4bd7-a083-ba080565d25e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92542024-11-27T18:43:00.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 425d8181-741e-4bd7-a083-ba080565d25e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92552024-11-27T18:43:00.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 425d8181-741e-4bd7-a083-ba080565d25e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92562024-11-27T18:43:01.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9585d765-09e4-47df-be74-28673c200612 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92572024-11-27T18:43:01.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9585d765-09e4-47df-be74-28673c200612 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92582024-11-27T18:43:01.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9585d765-09e4-47df-be74-28673c200612 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
92592024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
92602024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
92612024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92622024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92632024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92642024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92652024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92662024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92672024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
92682024-11-27T18:43:01.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92692024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92702024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92712024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
92722024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92732024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92742024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92752024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92762024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92772024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
92782024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
92792024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92802024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
92812024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92822024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92832024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
92842024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
92852024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92862024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92872024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
92882024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92892024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92902024-11-27T18:43:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92912024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92922024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92932024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92942024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92952024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92962024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92972024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92982024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92992024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93002024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93012024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
93022024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
93032024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93042024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
93052024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93062024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93072024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93082024-11-27T18:43:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93092024-11-27T18:43:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93102024-11-27T18:43:01.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93112024-11-27T18:43:01.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.964919ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93122024-11-27T18:43:01.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93132024-11-27T18:43:01.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93142024-11-27T18:43:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93152024-11-27T18:43:01.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93162024-11-27T18:43:01.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 398964672 } })
93172024-11-27T18:43:01.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93182024-11-27T18:43:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93192024-11-27T18:43:01.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93202024-11-27T18:43:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93212024-11-27T18:43:01.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 402668847 } })
93222024-11-27T18:43:01.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93232024-11-27T18:43:01.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93242024-11-27T18:43:01.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93252024-11-27T18:43:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93262024-11-27T18:43:01.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93272024-11-27T18:43:01.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93282024-11-27T18:43:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93292024-11-27T18:43:01.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93302024-11-27T18:43:01.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93312024-11-27T18:43:01.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93322024-11-27T18:43:01.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93332024-11-27T18:43:01.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93342024-11-27T18:43:01.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93352024-11-27T18:43:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93362024-11-27T18:43:01.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93372024-11-27T18:43:01.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-11-27T18:43:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93392024-11-27T18:43:01.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93402024-11-27T18:43:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93412024-11-27T18:43:01.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93422024-11-27T18:43:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93432024-11-27T18:43:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93442024-11-27T18:43:01.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.89879ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
93452024-11-27T18:43:01.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93462024-11-27T18:43:01.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93472024-11-27T18:43:01.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93482024-11-27T18:43:01.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93492024-11-27T18:43:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93502024-11-27T18:43:01.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93512024-11-27T18:43:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93522024-11-27T18:43:01.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93532024-11-27T18:43:01.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93542024-11-27T18:43:01.448ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93552024-11-27T18:43:01.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93562024-11-27T18:43:01.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 444945884 } })
93572024-11-27T18:43:01.448ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b48a8a52-4a1d-4bed-9f9b-109fb18e1f04", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
93582024-11-27T18:43:01.448ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93592024-11-27T18:43:01.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.348445ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
93602024-11-27T18:43:01.449ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
93612024-11-27T18:43:01.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93622024-11-27T18:43:01.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93632024-11-27T18:43:01.450ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93642024-11-27T18:43:01.450ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93652024-11-27T18:43:01.450ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b26737e1-a032-462d-afe9-851e00ae29c0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
93662024-11-27T18:43:01.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93672024-11-27T18:43:01.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-11-27T18:43:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93692024-11-27T18:43:01.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93702024-11-27T18:43:01.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93712024-11-27T18:43:01.452ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93722024-11-27T18:43:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93732024-11-27T18:43:01.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93742024-11-27T18:43:01.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93752024-11-27T18:43:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93762024-11-27T18:43:01.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93772024-11-27T18:43:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93782024-11-27T18:43:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93792024-11-27T18:43:01.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93802024-11-27T18:43:01.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
93812024-11-27T18:43:01.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93822024-11-27T18:43:01.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93832024-11-27T18:43:01.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93842024-11-27T18:43:01.477ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93852024-11-27T18:43:01.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93862024-11-27T18:43:01.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93872024-11-27T18:43:01.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93882024-11-27T18:43:01.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93892024-11-27T18:43:01.487ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93902024-11-27T18:43:01.487ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93912024-11-27T18:43:01.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93922024-11-27T18:43:01.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93932024-11-27T18:43:01.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.260911ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93942024-11-27T18:43:01.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93952024-11-27T18:43:01.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.288893ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93962024-11-27T18:43:01.492ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
93972024-11-27T18:43:01.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.570426ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
93982024-11-27T18:43:01.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.976102ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93992024-11-27T18:43:01.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.49365ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94002024-11-27T18:43:01.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.138436ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94012024-11-27T18:43:01.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94022024-11-27T18:43:01.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94032024-11-27T18:43:01.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94042024-11-27T18:43:01.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
94052024-11-27T18:43:01.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94062024-11-27T18:43:01.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94072024-11-27T18:43:01.529ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94082024-11-27T18:43:01.529ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94092024-11-27T18:43:01.529ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.241534ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94102024-11-27T18:43:01.555ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.198799ms iteration = 20 status = {"physical_disks_added":0}
94112024-11-27T18:43:01.560ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
94122024-11-27T18:43:01.560ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94132024-11-27T18:43:01.561ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65c20d32-adb7-4ae2-a48c-8763111f650e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94142024-11-27T18:43:01.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94152024-11-27T18:43:01.563ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
94162024-11-27T18:43:01.611ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94172024-11-27T18:43:01.611ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94182024-11-27T18:43:01.611ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c746dc-eb05-436d-896c-1b7e80eaf4a8", "content-length": "372", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94192024-11-27T18:43:01.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94202024-11-27T18:43:01.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94212024-11-27T18:43:01.613ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 220.962105ms iteration = 18 status = 0
94222024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94232024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94242024-11-27T18:43:01.647ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 254.859118ms iteration = 18 status = {}
94252024-11-27T18:43:01.654ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94262024-11-27T18:43:01.654ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "108fcb3b-bb48-48c9-9741-d4e59190991a", "content-length": "1", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94272024-11-27T18:43:01.657ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94282024-11-27T18:43:01.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94292024-11-27T18:43:01.659ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.342393ms iteration = 18 status = null
94302024-11-27T18:43:01.677ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94312024-11-27T18:43:01.677ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94322024-11-27T18:43:01.677ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "58ad1726-ed2b-4758-b82a-d3f0bb539705", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94332024-11-27T18:43:01.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94342024-11-27T18:43:01.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94352024-11-27T18:43:01.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94362024-11-27T18:43:01.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94372024-11-27T18:43:01.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94382024-11-27T18:43:01.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94392024-11-27T18:43:01.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94402024-11-27T18:43:01.690ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94412024-11-27T18:43:01.690ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94422024-11-27T18:43:01.691ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "de9f54ad-9801-4e9b-9fe5-c56cfcbc7039", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94432024-11-27T18:43:01.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94442024-11-27T18:43:01.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94452024-11-27T18:43:01.693ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.8813ms iteration = 18 status = {}
94462024-11-27T18:43:01.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94472024-11-27T18:43:01.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94482024-11-27T18:43:01.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94492024-11-27T18:43:01.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94502024-11-27T18:43:01.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94512024-11-27T18:43:01.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94522024-11-27T18:43:01.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94532024-11-27T18:43:01.732ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
94542024-11-27T18:43:01.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94552024-11-27T18:43:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94562024-11-27T18:43:01.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94572024-11-27T18:43:01.750ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be1fd5d-e066-4203-86de-d0edc6c74eba", "content-length": "134", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94582024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94592024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
94602024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94612024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94622024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94632024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94642024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94652024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94662024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94672024-11-27T18:43:01.750ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94682024-11-27T18:43:01.751ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
94692024-11-27T18:43:01.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94702024-11-27T18:43:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94712024-11-27T18:43:01.753ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94722024-11-27T18:43:01.753ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcab1603-34ed-4d33-bda9-78f4442c07e4", "content-length": "2", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94732024-11-27T18:43:01.753ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94742024-11-27T18:43:01.754ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "59d7a43b-235d-4ef6-aa2b-f8a1fce6b1a9", "content-length": "52", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94752024-11-27T18:43:01.754ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
94762024-11-27T18:43:01.754ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94772024-11-27T18:43:01.828ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94782024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "864ac774-ee91-4384-bc55-1b16b6e4c1aa", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94792024-11-27T18:43:01.848ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
94802024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94812024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "88c7c506-ea76-4a23-b079-7decbea8ee21", "content-length": "682", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94822024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94832024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94842024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d820776-6977-4740-a27d-585d06e07acf", "content-length": "691", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
94852024-11-27T18:43:01.849ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
94862024-11-27T18:43:01.849ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
94872024-11-27T18:43:01.849ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
94882024-11-27T18:43:01.850ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.843026ms iteration = 18 status = {}
94892024-11-27T18:43:01.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94902024-11-27T18:43:01.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94912024-11-27T18:43:01.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94922024-11-27T18:43:01.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94932024-11-27T18:43:01.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94942024-11-27T18:43:01.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94952024-11-27T18:43:01.865ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 473.118982ms iteration = 18 status = {}
94962024-11-27T18:43:02.101ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94972024-11-27T18:43:02.101ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
94982024-11-27T18:43:02.131ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
94992024-11-27T18:43:02.132ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:41369
95002024-11-27T18:43:02.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41369 req_id = 93a9b5be-30ed-47a0-9b5a-eeb20e840175 roles = RoleSet { roles: {} } uri = /metrics/producers
95012024-11-27T18:43:02.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41369 req_id = 93a9b5be-30ed-47a0-9b5a-eeb20e840175 resource = Database result = Ok(()) uri = /metrics/producers
95022024-11-27T18:43:02.167ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 236c7b74-8315-46e3-9a37-90380a675558
95032024-11-27T18:43:02.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35210 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:41369 req_id = 93a9b5be-30ed-47a0-9b5a-eeb20e840175 response_code = 201 uri = /metrics/producers
95042024-11-27T18:43:02.167ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "93a9b5be-30ed-47a0-9b5a-eeb20e840175", "content-length": "41", "date": "Wed, 27 Nov 2024 18:43:02 GMT"} })
95052024-11-27T18:43:02.169ZDEBGnexus (producer-registration-task): registered with nexus successfully
95062024-11-27T18:43:02.169ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
95072024-11-27T18:43:02.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abfd6108-6fc2-4007-b4c4-cfde083463c1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95082024-11-27T18:43:02.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abfd6108-6fc2-4007-b4c4-cfde083463c1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95092024-11-27T18:43:02.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = abfd6108-6fc2-4007-b4c4-cfde083463c1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95102024-11-27T18:43:02.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b31a24a4-a150-4b1f-8ab8-8e6fc1db8a97 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
95112024-11-27T18:43:02.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b31a24a4-a150-4b1f-8ab8-8e6fc1db8a97 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
95122024-11-27T18:43:02.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b31a24a4-a150-4b1f-8ab8-8e6fc1db8a97 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
95132024-11-27T18:43:03.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc3e5539-0d56-4aec-ba94-2fd020504463 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95142024-11-27T18:43:03.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc3e5539-0d56-4aec-ba94-2fd020504463 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95152024-11-27T18:43:03.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bc3e5539-0d56-4aec-ba94-2fd020504463 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95162024-11-27T18:43:03.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 5d18319d-db8c-402a-99e9-504aef7f7bef response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
95172024-11-27T18:43:04.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d775a066-df1c-4d20-8755-400c637dc083 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95182024-11-27T18:43:04.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d775a066-df1c-4d20-8755-400c637dc083 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95192024-11-27T18:43:04.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d775a066-df1c-4d20-8755-400c637dc083 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95202024-11-27T18:43:05.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f24968-8854-4604-bf22-f32824cb7bb7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95212024-11-27T18:43:05.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f24968-8854-4604-bf22-f32824cb7bb7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95222024-11-27T18:43:05.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f24968-8854-4604-bf22-f32824cb7bb7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95232024-11-27T18:43:06.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1de9b430-9c2e-4fa9-8a71-c747db70fe86 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95242024-11-27T18:43:06.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1de9b430-9c2e-4fa9-8a71-c747db70fe86 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95252024-11-27T18:43:06.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1de9b430-9c2e-4fa9-8a71-c747db70fe86 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95262024-11-27T18:43:07.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = adbb7de0-f493-4fd7-b74f-a293f2c3539d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95272024-11-27T18:43:07.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = adbb7de0-f493-4fd7-b74f-a293f2c3539d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95282024-11-27T18:43:07.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = adbb7de0-f493-4fd7-b74f-a293f2c3539d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95292024-11-27T18:43:08.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6e5b4fb-20be-4bef-87c1-93bd182b1ed6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95302024-11-27T18:43:08.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6e5b4fb-20be-4bef-87c1-93bd182b1ed6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95312024-11-27T18:43:08.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a6e5b4fb-20be-4bef-87c1-93bd182b1ed6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95322024-11-27T18:43:09.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fcee39f-3078-4135-aeba-6dc6bbde5530 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95332024-11-27T18:43:09.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fcee39f-3078-4135-aeba-6dc6bbde5530 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95342024-11-27T18:43:09.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6fcee39f-3078-4135-aeba-6dc6bbde5530 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95352024-11-27T18:43:10.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77e7d6b2-1985-4745-902e-cfdba8f23c16 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95362024-11-27T18:43:10.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77e7d6b2-1985-4745-902e-cfdba8f23c16 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95372024-11-27T18:43:10.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 77e7d6b2-1985-4745-902e-cfdba8f23c16 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95382024-11-27T18:43:11.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
95392024-11-27T18:43:11.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95402024-11-27T18:43:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95412024-11-27T18:43:11.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
95422024-11-27T18:43:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95432024-11-27T18:43:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95442024-11-27T18:43:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95452024-11-27T18:43:11.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95462024-11-27T18:43:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95472024-11-27T18:43:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95482024-11-27T18:43:11.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95492024-11-27T18:43:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95502024-11-27T18:43:11.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95512024-11-27T18:43:11.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95522024-11-27T18:43:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95532024-11-27T18:43:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
95542024-11-27T18:43:11.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95552024-11-27T18:43:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95562024-11-27T18:43:11.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
95572024-11-27T18:43:11.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.864794ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
95582024-11-27T18:43:11.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.826917ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95592024-11-27T18:43:11.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 901affe9-581b-48fd-bc88-a5d9c4ef8c6e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95602024-11-27T18:43:11.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 901affe9-581b-48fd-bc88-a5d9c4ef8c6e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95612024-11-27T18:43:11.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 901affe9-581b-48fd-bc88-a5d9c4ef8c6e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95622024-11-27T18:43:12.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 70778f47-3c94-4ce3-9a47-d669987de1e9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95632024-11-27T18:43:12.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 70778f47-3c94-4ce3-9a47-d669987de1e9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95642024-11-27T18:43:12.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 70778f47-3c94-4ce3-9a47-d669987de1e9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95652024-11-27T18:43:13.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c6bb387-6bdc-4773-ba1e-5d351276e7fd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95662024-11-27T18:43:13.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c6bb387-6bdc-4773-ba1e-5d351276e7fd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95672024-11-27T18:43:13.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0c6bb387-6bdc-4773-ba1e-5d351276e7fd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95682024-11-27T18:43:13.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ccf860f4-634f-4da6-8e3a-668f86f688cf response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
95692024-11-27T18:43:14.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a241a694-eba6-4979-9e05-7443b774e9e9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95702024-11-27T18:43:14.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a241a694-eba6-4979-9e05-7443b774e9e9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95712024-11-27T18:43:14.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a241a694-eba6-4979-9e05-7443b774e9e9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95722024-11-27T18:43:15.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 401c0cf0-74ce-45f4-9d76-48f7cb5b74f1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95732024-11-27T18:43:15.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 401c0cf0-74ce-45f4-9d76-48f7cb5b74f1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95742024-11-27T18:43:15.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 401c0cf0-74ce-45f4-9d76-48f7cb5b74f1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95752024-11-27T18:43:16.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dd1b4d48-f6f7-4a42-81be-e0dbda7d9605 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95762024-11-27T18:43:16.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dd1b4d48-f6f7-4a42-81be-e0dbda7d9605 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95772024-11-27T18:43:16.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dd1b4d48-f6f7-4a42-81be-e0dbda7d9605 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95782024-11-27T18:43:17.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53b4666e-1010-49dd-afc8-6f66eb72ea63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95792024-11-27T18:43:17.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53b4666e-1010-49dd-afc8-6f66eb72ea63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95802024-11-27T18:43:17.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 53b4666e-1010-49dd-afc8-6f66eb72ea63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95812024-11-27T18:43:18.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28a3415c-8499-4ddf-a4d4-966f92aeb957 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95822024-11-27T18:43:18.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28a3415c-8499-4ddf-a4d4-966f92aeb957 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95832024-11-27T18:43:18.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28a3415c-8499-4ddf-a4d4-966f92aeb957 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95842024-11-27T18:43:19.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb53e334-2beb-4290-8579-ebba09a00ca0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95852024-11-27T18:43:19.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb53e334-2beb-4290-8579-ebba09a00ca0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95862024-11-27T18:43:19.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cb53e334-2beb-4290-8579-ebba09a00ca0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95872024-11-27T18:43:20.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c80d604-e5c3-4a64-a4ec-0fdeb438660d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95882024-11-27T18:43:20.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c80d604-e5c3-4a64-a4ec-0fdeb438660d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95892024-11-27T18:43:20.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8c80d604-e5c3-4a64-a4ec-0fdeb438660d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
95902024-11-27T18:43:21.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
95912024-11-27T18:43:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95922024-11-27T18:43:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95932024-11-27T18:43:21.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
95942024-11-27T18:43:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95952024-11-27T18:43:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95962024-11-27T18:43:21.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95972024-11-27T18:43:21.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95982024-11-27T18:43:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95992024-11-27T18:43:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96002024-11-27T18:43:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96012024-11-27T18:43:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96022024-11-27T18:43:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032024-11-27T18:43:21.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96042024-11-27T18:43:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96052024-11-27T18:43:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
96062024-11-27T18:43:21.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96072024-11-27T18:43:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96082024-11-27T18:43:21.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
96092024-11-27T18:43:21.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.756197ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
96102024-11-27T18:43:21.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.10484ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96112024-11-27T18:43:21.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2365bcc3-d00b-4005-98b6-030acd8b3adf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96122024-11-27T18:43:21.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2365bcc3-d00b-4005-98b6-030acd8b3adf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96132024-11-27T18:43:21.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2365bcc3-d00b-4005-98b6-030acd8b3adf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96142024-11-27T18:43:22.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5babd38e-b687-4052-9d4f-abc3dd3247bd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96152024-11-27T18:43:22.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5babd38e-b687-4052-9d4f-abc3dd3247bd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96162024-11-27T18:43:22.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5babd38e-b687-4052-9d4f-abc3dd3247bd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96172024-11-27T18:43:23.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ae6f5af3-cd76-438f-aa4a-95aa0803256e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
96182024-11-27T18:43:23.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c043fd09-deda-4d5a-99c8-8e9b3599a386 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96192024-11-27T18:43:23.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c043fd09-deda-4d5a-99c8-8e9b3599a386 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96202024-11-27T18:43:23.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c043fd09-deda-4d5a-99c8-8e9b3599a386 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96212024-11-27T18:43:24.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fe4d5e4-76bb-4a33-a97b-cfc6ba7caa62 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96222024-11-27T18:43:24.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fe4d5e4-76bb-4a33-a97b-cfc6ba7caa62 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96232024-11-27T18:43:24.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8fe4d5e4-76bb-4a33-a97b-cfc6ba7caa62 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96242024-11-27T18:43:25.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c77cd1a-017e-4b2d-a95b-4c69753e8259 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96252024-11-27T18:43:25.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c77cd1a-017e-4b2d-a95b-4c69753e8259 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96262024-11-27T18:43:25.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c77cd1a-017e-4b2d-a95b-4c69753e8259 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96272024-11-27T18:43:26.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e90c7afc-f260-4035-a27c-ed5f76cef8a7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96282024-11-27T18:43:26.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e90c7afc-f260-4035-a27c-ed5f76cef8a7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96292024-11-27T18:43:26.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e90c7afc-f260-4035-a27c-ed5f76cef8a7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96302024-11-27T18:43:27.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b645754-c7f9-43cf-a8ea-9fe838e1851e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96312024-11-27T18:43:27.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b645754-c7f9-43cf-a8ea-9fe838e1851e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96322024-11-27T18:43:27.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4b645754-c7f9-43cf-a8ea-9fe838e1851e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96332024-11-27T18:43:28.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc048e0a-3145-4e83-b6fa-a67ef701fab6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96342024-11-27T18:43:28.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc048e0a-3145-4e83-b6fa-a67ef701fab6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96352024-11-27T18:43:28.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fc048e0a-3145-4e83-b6fa-a67ef701fab6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96362024-11-27T18:43:29.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee203254-3b0f-4a2b-93ee-2022ca176bc9 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96372024-11-27T18:43:29.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee203254-3b0f-4a2b-93ee-2022ca176bc9 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96382024-11-27T18:43:29.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ee203254-3b0f-4a2b-93ee-2022ca176bc9 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96392024-11-27T18:43:30.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 83cd7c2c-32f7-4da7-b7d8-7d27e80dee51 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96402024-11-27T18:43:30.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 83cd7c2c-32f7-4da7-b7d8-7d27e80dee51 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96412024-11-27T18:43:30.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 83cd7c2c-32f7-4da7-b7d8-7d27e80dee51 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
96422024-11-27T18:43:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96432024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96442024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
96452024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96462024-11-27T18:43:31.393ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
96472024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96482024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.08\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
96492024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96502024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96512024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96522024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
96532024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
96542024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96552024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
96562024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96572024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
96582024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96592024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
96602024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
96612024-11-27T18:43:31.393ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:33:31.393091842 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96622024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96632024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96642024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96652024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
96662024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
96672024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96682024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96692024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
96702024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96712024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96722024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96732024-11-27T18:43:31.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96742024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96752024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96762024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96772024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
96782024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
96792024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96802024-11-27T18:43:31.393ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96812024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96822024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96832024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96842024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96852024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96862024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
96872024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96882024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96892024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96902024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
96912024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96922024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96932024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96942024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96952024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96962024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96972024-11-27T18:43:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96982024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96992024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
97002024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97012024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
97022024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97032024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
97042024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97052024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
97062024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97072024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97082024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97092024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97102024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97112024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97122024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97132024-11-27T18:43:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 390073331 } })
97142024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97152024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97162024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97172024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97182024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97192024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97202024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97212024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97222024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97232024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97242024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97252024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97262024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97272024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97282024-11-27T18:43:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 390214323 } })
97292024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97302024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97312024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97322024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97332024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97342024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97352024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97362024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
97372024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.36375ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
97382024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97392024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97402024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
97412024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.060145ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
97422024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97432024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97442024-11-27T18:43:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97452024-11-27T18:43:31.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97462024-11-27T18:43:31.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97472024-11-27T18:43:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.567468ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
97482024-11-27T18:43:31.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97492024-11-27T18:43:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.788186ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97502024-11-27T18:43:31.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512024-11-27T18:43:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97522024-11-27T18:43:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97532024-11-27T18:43:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97542024-11-27T18:43:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97552024-11-27T18:43:31.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97562024-11-27T18:43:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97572024-11-27T18:43:31.402ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:33:31.393091842 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97582024-11-27T18:43:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.021713ms iteration = 10 status = {"expiration":"2024-11-27T18:33:31.393091842Z","pruned":[]}
97592024-11-27T18:43:31.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97602024-11-27T18:43:31.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97612024-11-27T18:43:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97622024-11-27T18:43:31.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97632024-11-27T18:43:31.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97642024-11-27T18:43:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97652024-11-27T18:43:31.405ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.757344ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97662024-11-27T18:43:31.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672024-11-27T18:43:31.412ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-11-27T18:43:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97692024-11-27T18:43:31.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97702024-11-27T18:43:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97712024-11-27T18:43:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97722024-11-27T18:43:31.415ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97732024-11-27T18:43:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97742024-11-27T18:43:31.418ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 414159368 } })
97752024-11-27T18:43:31.418ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97762024-11-27T18:43:31.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97772024-11-27T18:43:31.419ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 415642190 } })
97782024-11-27T18:43:31.419ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97792024-11-27T18:43:31.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97802024-11-27T18:43:31.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97812024-11-27T18:43:31.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97822024-11-27T18:43:31.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97832024-11-27T18:43:31.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97842024-11-27T18:43:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97852024-11-27T18:43:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97862024-11-27T18:43:31.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97872024-11-27T18:43:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97882024-11-27T18:43:31.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.050748ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97892024-11-27T18:43:31.437ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97902024-11-27T18:43:31.437ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97912024-11-27T18:43:31.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97922024-11-27T18:43:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97932024-11-27T18:43:31.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942024-11-27T18:43:31.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952024-11-27T18:43:31.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97962024-11-27T18:43:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97972024-11-27T18:43:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97982024-11-27T18:43:31.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992024-11-27T18:43:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98002024-11-27T18:43:31.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98012024-11-27T18:43:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98022024-11-27T18:43:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98032024-11-27T18:43:31.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98042024-11-27T18:43:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98052024-11-27T18:43:31.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98062024-11-27T18:43:31.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98072024-11-27T18:43:31.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98082024-11-27T18:43:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98092024-11-27T18:43:31.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98112024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98122024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98132024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98142024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
98152024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98162024-11-27T18:43:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98172024-11-27T18:43:31.453ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98182024-11-27T18:43:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98192024-11-27T18:43:31.455ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98202024-11-27T18:43:31.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98212024-11-27T18:43:31.456ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98222024-11-27T18:43:31.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98232024-11-27T18:43:31.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98242024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98262024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98272024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98282024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98292024-11-27T18:43:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98302024-11-27T18:43:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98312024-11-27T18:43:31.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98322024-11-27T18:43:31.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.571297ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98332024-11-27T18:43:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98342024-11-27T18:43:31.462ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98352024-11-27T18:43:31.462ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98362024-11-27T18:43:31.462ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.893241ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98372024-11-27T18:43:31.462ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 458630627 } })
98382024-11-27T18:43:31.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
98392024-11-27T18:43:31.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.069194ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98402024-11-27T18:43:31.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-11-27T18:43:31.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98422024-11-27T18:43:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98432024-11-27T18:43:31.466ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98442024-11-27T18:43:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98452024-11-27T18:43:31.467ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98462024-11-27T18:43:31.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98472024-11-27T18:43:31.469ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98482024-11-27T18:43:31.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98492024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
98502024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98512024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98522024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98532024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98542024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98552024-11-27T18:43:31.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98562024-11-27T18:43:31.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98572024-11-27T18:43:31.472ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 79.437078ms iteration = 5 status = {"nsuccess":5}
98582024-11-27T18:43:31.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98592024-11-27T18:43:31.475ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
98602024-11-27T18:43:31.475ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.437942ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
98612024-11-27T18:43:31.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98622024-11-27T18:43:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98632024-11-27T18:43:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98642024-11-27T18:43:31.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98652024-11-27T18:43:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98662024-11-27T18:43:31.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98672024-11-27T18:43:31.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98682024-11-27T18:43:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98692024-11-27T18:43:31.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98702024-11-27T18:43:31.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98712024-11-27T18:43:31.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98722024-11-27T18:43:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98732024-11-27T18:43:31.481ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98742024-11-27T18:43:31.481ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98752024-11-27T18:43:31.481ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98762024-11-27T18:43:31.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98772024-11-27T18:43:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98782024-11-27T18:43:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
98792024-11-27T18:43:31.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98802024-11-27T18:43:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98812024-11-27T18:43:31.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98822024-11-27T18:43:31.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98832024-11-27T18:43:31.488ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.902381ms iteration = 19 status = 0
98842024-11-27T18:43:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98852024-11-27T18:43:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98862024-11-27T18:43:31.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98872024-11-27T18:43:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98882024-11-27T18:43:31.494ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98892024-11-27T18:43:31.494ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98902024-11-27T18:43:31.494ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.692518ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98912024-11-27T18:43:31.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98922024-11-27T18:43:31.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98932024-11-27T18:43:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98942024-11-27T18:43:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98952024-11-27T18:43:31.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98962024-11-27T18:43:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98972024-11-27T18:43:31.503ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98982024-11-27T18:43:31.503ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98992024-11-27T18:43:31.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99002024-11-27T18:43:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99012024-11-27T18:43:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.778797ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
99022024-11-27T18:43:31.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99032024-11-27T18:43:31.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99042024-11-27T18:43:31.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.607434ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
99052024-11-27T18:43:31.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99062024-11-27T18:43:31.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99072024-11-27T18:43:31.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99082024-11-27T18:43:31.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99092024-11-27T18:43:31.511ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
99102024-11-27T18:43:31.511ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.729965ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
99112024-11-27T18:43:31.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99122024-11-27T18:43:31.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99132024-11-27T18:43:31.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99142024-11-27T18:43:31.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99152024-11-27T18:43:31.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99162024-11-27T18:43:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99172024-11-27T18:43:31.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99182024-11-27T18:43:31.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99192024-11-27T18:43:31.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99202024-11-27T18:43:31.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99212024-11-27T18:43:31.521ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99222024-11-27T18:43:31.521ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
99232024-11-27T18:43:31.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99242024-11-27T18:43:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99252024-11-27T18:43:31.528ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
99262024-11-27T18:43:31.528ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
99272024-11-27T18:43:31.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99282024-11-27T18:43:31.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99292024-11-27T18:43:31.534ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99302024-11-27T18:43:31.534ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99312024-11-27T18:43:31.534ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.994589ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99322024-11-27T18:43:31.539ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.998594ms iteration = 21 status = {"physical_disks_added":0}
99332024-11-27T18:43:31.567ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99342024-11-27T18:43:31.567ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99352024-11-27T18:43:31.568ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37fcb5a8-3c83-470b-805f-be01e09d274a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99362024-11-27T18:43:31.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99372024-11-27T18:43:31.569ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99382024-11-27T18:43:31.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99392024-11-27T18:43:31.571ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99402024-11-27T18:43:31.571ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f18c5af-454f-4263-a745-def7b8ddc0a8", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99412024-11-27T18:43:31.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99422024-11-27T18:43:31.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99432024-11-27T18:43:31.587ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99442024-11-27T18:43:31.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.634605ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99452024-11-27T18:43:31.660ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99462024-11-27T18:43:31.669ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
99472024-11-27T18:43:31.669ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99482024-11-27T18:43:31.670ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f14c649-4992-42b8-91cd-48d8e5d8f39a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99492024-11-27T18:43:31.670ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99502024-11-27T18:43:31.672ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
99512024-11-27T18:43:31.727ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99522024-11-27T18:43:31.741ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99532024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "553de0bf-de43-402d-a587-ecd77543f6e2", "content-length": "691", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99542024-11-27T18:43:31.742ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99552024-11-27T18:43:31.742ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99562024-11-27T18:43:31.742ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99572024-11-27T18:43:31.743ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.460454ms iteration = 19 status = {}
99582024-11-27T18:43:31.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99592024-11-27T18:43:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99602024-11-27T18:43:31.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99612024-11-27T18:43:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99622024-11-27T18:43:31.759ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
99632024-11-27T18:43:31.759ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
99642024-11-27T18:43:31.759ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
99652024-11-27T18:43:31.759ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 366.260238ms iteration = 10 status = {"generation":2}
99662024-11-27T18:43:31.777ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99672024-11-27T18:43:31.778ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8c8553a-0f08-4b4c-920b-d72eb9fa072f", "content-length": "1", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99682024-11-27T18:43:31.780ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99692024-11-27T18:43:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99702024-11-27T18:43:31.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99712024-11-27T18:43:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99722024-11-27T18:43:31.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99732024-11-27T18:43:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99742024-11-27T18:43:31.783ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99752024-11-27T18:43:31.783ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99762024-11-27T18:43:31.784ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "71c44ac9-0a0f-45fb-9b6c-e1039c3aab8b", "content-length": "372", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99772024-11-27T18:43:31.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99782024-11-27T18:43:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99792024-11-27T18:43:31.784ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 391.242819ms iteration = 19 status = null
99802024-11-27T18:43:31.785ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
99812024-11-27T18:43:31.785ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 392.68376ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99822024-11-27T18:43:31.786ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99832024-11-27T18:43:31.786ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99842024-11-27T18:43:31.786ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
99852024-11-27T18:43:31.786ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 393.269978ms iteration = 10 status = {"generation":1}
99862024-11-27T18:43:31.793ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 399.820266ms iteration = 19 status = {}
99872024-11-27T18:43:31.800ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
99882024-11-27T18:43:31.800ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99892024-11-27T18:43:31.800ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f843a60-9f53-4384-94b3-e5ab67b5512d", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99902024-11-27T18:43:31.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99912024-11-27T18:43:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99922024-11-27T18:43:31.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99932024-11-27T18:43:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99942024-11-27T18:43:31.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99952024-11-27T18:43:31.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99962024-11-27T18:43:31.808ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99972024-11-27T18:43:31.808ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99982024-11-27T18:43:31.808ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8938c09f-aac9-4ccc-9aec-02cc791265a0", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
99992024-11-27T18:43:31.810ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 416.883018ms iteration = 19 status = {}
100002024-11-27T18:43:31.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
100012024-11-27T18:43:31.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d5057dc6-52ac-4922-8120-9618892b2ff1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100022024-11-27T18:43:31.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d5057dc6-52ac-4922-8120-9618892b2ff1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100032024-11-27T18:43:31.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d5057dc6-52ac-4922-8120-9618892b2ff1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100042024-11-27T18:43:31.964ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
100052024-11-27T18:43:31.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f688bf2d-92bb-4db8-906c-946e81ebf63e", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100062024-11-27T18:43:31.965ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100072024-11-27T18:43:31.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "08afb8ee-cb56-4ae9-8e66-e61fa95e7f2f", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100082024-11-27T18:43:31.966ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100092024-11-27T18:43:31.968ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
100102024-11-27T18:43:31.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 575.326227ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
100112024-11-27T18:43:31.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100122024-11-27T18:43:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100132024-11-27T18:43:31.993ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
100142024-11-27T18:43:31.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100152024-11-27T18:43:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100162024-11-27T18:43:31.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
100172024-11-27T18:43:31.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "74163c91-32d5-426b-aaf0-f25391d9de0c", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100182024-11-27T18:43:31.997ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100192024-11-27T18:43:31.999ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "378d8e2e-d7d7-4ee9-934b-80e12dbc658a", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100202024-11-27T18:43:31.999ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100212024-11-27T18:43:32.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "12aa078f-95f9-461b-98f8-4f942b19e3ad", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100222024-11-27T18:43:32.001ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100232024-11-27T18:43:32.004ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100242024-11-27T18:43:32.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 610.860293ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
100252024-11-27T18:43:32.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100262024-11-27T18:43:32.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "15661b9e-6119-463f-8f36-f07c954a4c5b", "content-length": "134", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
100272024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100282024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
100292024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100302024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100312024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100322024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100332024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100342024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100352024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100362024-11-27T18:43:32.007ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100372024-11-27T18:43:32.008ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
100382024-11-27T18:43:32.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100392024-11-27T18:43:32.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100402024-11-27T18:43:32.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100412024-11-27T18:43:32.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "26269469-b73d-46eb-ab09-833dfc40d552", "content-length": "2", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
100422024-11-27T18:43:32.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100432024-11-27T18:43:32.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b1a6a10-8240-4424-a0b4-35dbb5dd24a7", "content-length": "52", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
100442024-11-27T18:43:32.018ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
100452024-11-27T18:43:32.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100462024-11-27T18:43:32.131ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "67e95e18-da54-449a-b4e5-2c4a0363242f", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
100472024-11-27T18:43:32.131ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
100482024-11-27T18:43:32.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100492024-11-27T18:43:32.131ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b387ec-6684-457f-a044-1f8a8385fa64", "content-length": "682", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
100502024-11-27T18:43:32.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100512024-11-27T18:43:32.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100522024-11-27T18:43:32.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100532024-11-27T18:43:32.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100542024-11-27T18:43:32.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100552024-11-27T18:43:32.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100562024-11-27T18:43:32.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100572024-11-27T18:43:32.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100582024-11-27T18:43:32.150ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.050841ms iteration = 19 status = {}
100592024-11-27T18:43:32.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b2bf02a4-fb9b-4b08-9133-255f8c4c346e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
100602024-11-27T18:43:32.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b2bf02a4-fb9b-4b08-9133-255f8c4c346e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
100612024-11-27T18:43:32.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = b2bf02a4-fb9b-4b08-9133-255f8c4c346e response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
100622024-11-27T18:43:32.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2aebf7e0-e576-435a-aecc-40b0d645cd4b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100632024-11-27T18:43:32.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2aebf7e0-e576-435a-aecc-40b0d645cd4b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100642024-11-27T18:43:32.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2aebf7e0-e576-435a-aecc-40b0d645cd4b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100652024-11-27T18:43:33.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = d991703d-94cc-4647-9a55-97aa45503194 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
100662024-11-27T18:43:33.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e656832-7c21-46af-92ff-0a27aecb1f63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100672024-11-27T18:43:33.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e656832-7c21-46af-92ff-0a27aecb1f63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100682024-11-27T18:43:33.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 8e656832-7c21-46af-92ff-0a27aecb1f63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100692024-11-27T18:43:34.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0f4b3180-c424-4b7e-ab2c-199fd6ec6620 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100702024-11-27T18:43:34.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0f4b3180-c424-4b7e-ab2c-199fd6ec6620 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100712024-11-27T18:43:34.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 0f4b3180-c424-4b7e-ab2c-199fd6ec6620 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100722024-11-27T18:43:36.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52ea1520-d81e-4065-ac62-7e577fbaf3ae roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100732024-11-27T18:43:36.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52ea1520-d81e-4065-ac62-7e577fbaf3ae resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100742024-11-27T18:43:36.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52ea1520-d81e-4065-ac62-7e577fbaf3ae response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100752024-11-27T18:43:37.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdff2c88-51ea-4ee8-9c68-245dab59d3f3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100762024-11-27T18:43:37.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdff2c88-51ea-4ee8-9c68-245dab59d3f3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100772024-11-27T18:43:37.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fdff2c88-51ea-4ee8-9c68-245dab59d3f3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100782024-11-27T18:43:38.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1465079a-c9a2-49ac-845f-2cdc5a6f9440 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100792024-11-27T18:43:38.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1465079a-c9a2-49ac-845f-2cdc5a6f9440 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100802024-11-27T18:43:38.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1465079a-c9a2-49ac-845f-2cdc5a6f9440 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100812024-11-27T18:43:39.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d541dd50-5576-4308-9d46-0e9bfb6bc672 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100822024-11-27T18:43:39.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d541dd50-5576-4308-9d46-0e9bfb6bc672 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100832024-11-27T18:43:39.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d541dd50-5576-4308-9d46-0e9bfb6bc672 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100842024-11-27T18:43:40.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bf67b2e-d36a-4809-adc7-326fb19a171b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100852024-11-27T18:43:40.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bf67b2e-d36a-4809-adc7-326fb19a171b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100862024-11-27T18:43:40.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9bf67b2e-d36a-4809-adc7-326fb19a171b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100872024-11-27T18:43:41.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80be9fcf-c4a2-407c-a370-fa8d1c9f644d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100882024-11-27T18:43:41.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80be9fcf-c4a2-407c-a370-fa8d1c9f644d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100892024-11-27T18:43:41.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 80be9fcf-c4a2-407c-a370-fa8d1c9f644d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
100902024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
100912024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100922024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100932024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
100942024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100952024-11-27T18:43:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100962024-11-27T18:43:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100972024-11-27T18:43:41.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100982024-11-27T18:43:41.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100992024-11-27T18:43:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.832267ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101002024-11-27T18:43:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101012024-11-27T18:43:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101022024-11-27T18:43:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101032024-11-27T18:43:41.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101042024-11-27T18:43:41.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101052024-11-27T18:43:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101062024-11-27T18:43:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
101072024-11-27T18:43:41.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101082024-11-27T18:43:41.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101092024-11-27T18:43:41.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
101102024-11-27T18:43:41.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.123653ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
101112024-11-27T18:43:42.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2d7b475d-b931-4be1-8b7f-2eecb31458e2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101122024-11-27T18:43:42.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2d7b475d-b931-4be1-8b7f-2eecb31458e2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101132024-11-27T18:43:42.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2d7b475d-b931-4be1-8b7f-2eecb31458e2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101142024-11-27T18:43:43.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28dacd67-df18-4138-96bd-179f9200bb70 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101152024-11-27T18:43:43.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28dacd67-df18-4138-96bd-179f9200bb70 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101162024-11-27T18:43:43.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 28dacd67-df18-4138-96bd-179f9200bb70 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101172024-11-27T18:43:43.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a0de03b0-a7ab-4ab8-a6be-226cbc5c0a07 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
101182024-11-27T18:43:44.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5e277ad5-3301-47e6-a1df-6a9b80e04b38 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101192024-11-27T18:43:44.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5e277ad5-3301-47e6-a1df-6a9b80e04b38 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101202024-11-27T18:43:44.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5e277ad5-3301-47e6-a1df-6a9b80e04b38 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101212024-11-27T18:43:45.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 23880b88-93e0-41ae-920b-edd45c242d48 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101222024-11-27T18:43:45.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 23880b88-93e0-41ae-920b-edd45c242d48 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101232024-11-27T18:43:45.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 23880b88-93e0-41ae-920b-edd45c242d48 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101242024-11-27T18:43:46.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1fd32ad8-606f-4166-8dcb-770ce5a5273c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101252024-11-27T18:43:46.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1fd32ad8-606f-4166-8dcb-770ce5a5273c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101262024-11-27T18:43:46.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1fd32ad8-606f-4166-8dcb-770ce5a5273c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101272024-11-27T18:43:47.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f28c1bbc-5e99-4073-9cfe-dce9f4a02b60 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101282024-11-27T18:43:47.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f28c1bbc-5e99-4073-9cfe-dce9f4a02b60 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101292024-11-27T18:43:47.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f28c1bbc-5e99-4073-9cfe-dce9f4a02b60 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101302024-11-27T18:43:48.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a990efc-b79f-4ff3-8967-a00401ace205 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101312024-11-27T18:43:48.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a990efc-b79f-4ff3-8967-a00401ace205 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101322024-11-27T18:43:48.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2a990efc-b79f-4ff3-8967-a00401ace205 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101332024-11-27T18:43:49.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 503ea090-63ed-4857-aedc-22b00ba40f22 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101342024-11-27T18:43:49.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 503ea090-63ed-4857-aedc-22b00ba40f22 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101352024-11-27T18:43:49.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 503ea090-63ed-4857-aedc-22b00ba40f22 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101362024-11-27T18:43:50.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e6f59c-a844-437f-a429-4b3ce3a7070c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101372024-11-27T18:43:50.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e6f59c-a844-437f-a429-4b3ce3a7070c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101382024-11-27T18:43:50.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 90e6f59c-a844-437f-a429-4b3ce3a7070c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101392024-11-27T18:43:51.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = daca85d4-0ac3-42b8-a51c-5f884109764d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101402024-11-27T18:43:51.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = daca85d4-0ac3-42b8-a51c-5f884109764d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101412024-11-27T18:43:51.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = daca85d4-0ac3-42b8-a51c-5f884109764d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101422024-11-27T18:43:51.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
101432024-11-27T18:43:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101442024-11-27T18:43:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101452024-11-27T18:43:51.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
101462024-11-27T18:43:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101472024-11-27T18:43:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101482024-11-27T18:43:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101492024-11-27T18:43:51.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101502024-11-27T18:43:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101512024-11-27T18:43:51.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.802907ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101522024-11-27T18:43:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101532024-11-27T18:43:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101542024-11-27T18:43:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101552024-11-27T18:43:51.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101562024-11-27T18:43:51.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101572024-11-27T18:43:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101582024-11-27T18:43:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
101592024-11-27T18:43:51.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101602024-11-27T18:43:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101612024-11-27T18:43:51.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
101622024-11-27T18:43:51.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.742103ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
101632024-11-27T18:43:52.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bca5b9bf-64cb-46ba-9874-1224cf7c7bea roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101642024-11-27T18:43:52.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bca5b9bf-64cb-46ba-9874-1224cf7c7bea resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101652024-11-27T18:43:52.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = bca5b9bf-64cb-46ba-9874-1224cf7c7bea response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101662024-11-27T18:43:53.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f11e6ef5-0355-4278-8680-e0e2055c1cbc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101672024-11-27T18:43:53.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f11e6ef5-0355-4278-8680-e0e2055c1cbc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101682024-11-27T18:43:53.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f11e6ef5-0355-4278-8680-e0e2055c1cbc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101692024-11-27T18:43:53.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = a48d9689-e9af-40c2-8fd9-17c424951694 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
101702024-11-27T18:43:54.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9ccd7d0-7f73-4486-8913-bc47aa753452 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101712024-11-27T18:43:54.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9ccd7d0-7f73-4486-8913-bc47aa753452 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101722024-11-27T18:43:54.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a9ccd7d0-7f73-4486-8913-bc47aa753452 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101732024-11-27T18:43:55.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322ec452-44c7-4afe-9b8f-00797fbf1b28 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101742024-11-27T18:43:55.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322ec452-44c7-4afe-9b8f-00797fbf1b28 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101752024-11-27T18:43:55.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 322ec452-44c7-4afe-9b8f-00797fbf1b28 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101762024-11-27T18:43:56.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9bd4ed5-584c-41ec-8a13-884a69800482 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101772024-11-27T18:43:56.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9bd4ed5-584c-41ec-8a13-884a69800482 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101782024-11-27T18:43:56.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e9bd4ed5-584c-41ec-8a13-884a69800482 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101792024-11-27T18:43:57.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3af793b9-973b-4b63-8b30-50c633e24e3f roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101802024-11-27T18:43:57.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3af793b9-973b-4b63-8b30-50c633e24e3f resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101812024-11-27T18:43:57.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3af793b9-973b-4b63-8b30-50c633e24e3f response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101822024-11-27T18:43:58.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d62223a-9597-438c-b4d4-d220cbfd7555 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101832024-11-27T18:43:58.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d62223a-9597-438c-b4d4-d220cbfd7555 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101842024-11-27T18:43:58.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7d62223a-9597-438c-b4d4-d220cbfd7555 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101852024-11-27T18:43:59.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2140ff67-34e8-4464-9670-2f1016f2e0b7 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101862024-11-27T18:43:59.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2140ff67-34e8-4464-9670-2f1016f2e0b7 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101872024-11-27T18:43:59.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2140ff67-34e8-4464-9670-2f1016f2e0b7 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101882024-11-27T18:44:00.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc6e5d2d-53e1-456d-8ee9-1225cfe39673 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101892024-11-27T18:44:00.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc6e5d2d-53e1-456d-8ee9-1225cfe39673 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101902024-11-27T18:44:00.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cc6e5d2d-53e1-456d-8ee9-1225cfe39673 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
101912024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101922024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101932024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101942024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101952024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101962024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101972024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101982024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101992024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
102002024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
102012024-11-27T18:44:01.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102022024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102032024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102042024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
102052024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
102062024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102072024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102082024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102092024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
102102024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
102112024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102122024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102132024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
102142024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102152024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
102162024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
102172024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102182024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
102192024-11-27T18:44:01.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102202024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102212024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102222024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102232024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102242024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102252024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102262024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102272024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102282024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102292024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102302024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102312024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102322024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102332024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
102342024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102352024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
102362024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102372024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
102382024-11-27T18:44:01.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102392024-11-27T18:44:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102402024-11-27T18:44:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102412024-11-27T18:44:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102422024-11-27T18:44:01.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.284089ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102432024-11-27T18:44:01.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 392461166 } })
102442024-11-27T18:44:01.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452024-11-27T18:44:01.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102462024-11-27T18:44:01.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.683354ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
102472024-11-27T18:44:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102482024-11-27T18:44:01.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102492024-11-27T18:44:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102502024-11-27T18:44:01.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512024-11-27T18:44:01.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102522024-11-27T18:44:01.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102532024-11-27T18:44:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102542024-11-27T18:44:01.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102552024-11-27T18:44:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102562024-11-27T18:44:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102572024-11-27T18:44:01.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102582024-11-27T18:44:01.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102592024-11-27T18:44:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102602024-11-27T18:44:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102612024-11-27T18:44:01.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102622024-11-27T18:44:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102632024-11-27T18:44:01.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102642024-11-27T18:44:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102652024-11-27T18:44:01.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102662024-11-27T18:44:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102672024-11-27T18:44:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102682024-11-27T18:44:01.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102692024-11-27T18:44:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102702024-11-27T18:44:01.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 402982572 } })
102712024-11-27T18:44:01.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102722024-11-27T18:44:01.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 403697333 } })
102732024-11-27T18:44:01.408ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
102742024-11-27T18:44:01.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102752024-11-27T18:44:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102762024-11-27T18:44:01.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102772024-11-27T18:44:01.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102782024-11-27T18:44:01.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102792024-11-27T18:44:01.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102802024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
102812024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102822024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102832024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102842024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102852024-11-27T18:44:01.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102862024-11-27T18:44:01.424ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102872024-11-27T18:44:01.424ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102882024-11-27T18:44:01.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102892024-11-27T18:44:01.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102902024-11-27T18:44:01.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.618043ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
102912024-11-27T18:44:01.428ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
102922024-11-27T18:44:01.428ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.263898ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
102932024-11-27T18:44:01.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102942024-11-27T18:44:01.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102952024-11-27T18:44:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102962024-11-27T18:44:01.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102972024-11-27T18:44:01.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102982024-11-27T18:44:01.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102992024-11-27T18:44:01.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103002024-11-27T18:44:01.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103012024-11-27T18:44:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103022024-11-27T18:44:01.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103032024-11-27T18:44:01.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103042024-11-27T18:44:01.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103052024-11-27T18:44:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103062024-11-27T18:44:01.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103072024-11-27T18:44:01.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103082024-11-27T18:44:01.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103092024-11-27T18:44:01.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103102024-11-27T18:44:01.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103112024-11-27T18:44:01.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103122024-11-27T18:44:01.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103132024-11-27T18:44:01.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103142024-11-27T18:44:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
103152024-11-27T18:44:01.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103162024-11-27T18:44:01.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103172024-11-27T18:44:01.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.709722ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103182024-11-27T18:44:01.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103192024-11-27T18:44:01.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103202024-11-27T18:44:01.446ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103212024-11-27T18:44:01.446ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.364806ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103222024-11-27T18:44:01.453ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103232024-11-27T18:44:01.453ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103242024-11-27T18:44:01.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103252024-11-27T18:44:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103262024-11-27T18:44:01.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.17453ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
103272024-11-27T18:44:01.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 73.086043ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
103282024-11-27T18:44:01.476ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103292024-11-27T18:44:01.476ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103302024-11-27T18:44:01.477ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88be98bb-1b1c-4f15-a8fd-1ce77656ea42", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103312024-11-27T18:44:01.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103322024-11-27T18:44:01.478ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103332024-11-27T18:44:01.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103342024-11-27T18:44:01.514ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103352024-11-27T18:44:01.514ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b417bc4-8a92-439a-8dd6-bec39a605876", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103362024-11-27T18:44:01.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103372024-11-27T18:44:01.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
103382024-11-27T18:44:01.514ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103392024-11-27T18:44:01.515ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48e8ba15-1e55-41f4-9283-ca471982b166", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103402024-11-27T18:44:01.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103412024-11-27T18:44:01.515ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.102025ms iteration = 22 status = {"physical_disks_added":0}
103422024-11-27T18:44:01.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
103432024-11-27T18:44:01.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103442024-11-27T18:44:01.542ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103452024-11-27T18:44:01.542ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103462024-11-27T18:44:01.543ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fe5ad61-eea2-4b22-8803-5d4190c10025", "content-length": "372", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103472024-11-27T18:44:01.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103482024-11-27T18:44:01.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103492024-11-27T18:44:01.545ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 153.226911ms iteration = 20 status = 0
103502024-11-27T18:44:01.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d84242-7f0f-4a2d-a7c7-1b968bdd278d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
103512024-11-27T18:44:01.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d84242-7f0f-4a2d-a7c7-1b968bdd278d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
103522024-11-27T18:44:01.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 30d84242-7f0f-4a2d-a7c7-1b968bdd278d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
103532024-11-27T18:44:01.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 180.600137ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103542024-11-27T18:44:01.584ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103552024-11-27T18:44:01.584ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103562024-11-27T18:44:01.584ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.952796ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103572024-11-27T18:44:01.586ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.073857ms iteration = 20 status = {}
103582024-11-27T18:44:01.603ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
103592024-11-27T18:44:01.603ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103602024-11-27T18:44:01.605ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "744aff13-8b7d-40c9-bc1b-b8c0d90fd9c3", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103612024-11-27T18:44:01.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103622024-11-27T18:44:01.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103632024-11-27T18:44:01.608ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103642024-11-27T18:44:01.608ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a22f08-2285-40bf-904e-3826134f5e27", "content-length": "1", "date": "Wed, 27 Nov 2024 18:44:00 GMT"} })
103652024-11-27T18:44:01.610ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103662024-11-27T18:44:01.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103672024-11-27T18:44:01.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103682024-11-27T18:44:01.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103692024-11-27T18:44:01.612ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.453909ms iteration = 20 status = null
103702024-11-27T18:44:01.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103712024-11-27T18:44:01.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103722024-11-27T18:44:01.618ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103732024-11-27T18:44:01.618ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103742024-11-27T18:44:01.618ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e083e878-f41f-4d9f-b5cb-38c86b9c0492", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
103752024-11-27T18:44:01.622ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 229.975719ms iteration = 20 status = {}
103762024-11-27T18:44:01.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103772024-11-27T18:44:01.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103782024-11-27T18:44:01.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103792024-11-27T18:44:01.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103802024-11-27T18:44:01.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103812024-11-27T18:44:01.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103822024-11-27T18:44:01.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103832024-11-27T18:44:01.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103842024-11-27T18:44:01.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103852024-11-27T18:44:01.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103862024-11-27T18:44:01.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103872024-11-27T18:44:01.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103882024-11-27T18:44:01.714ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
103892024-11-27T18:44:01.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103902024-11-27T18:44:01.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103912024-11-27T18:44:01.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103922024-11-27T18:44:01.725ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9a29925-9cab-46d4-a83c-f0e8804a8639", "content-length": "134", "date": "Wed, 27 Nov 2024 18:44:00 GMT"} })
103932024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103942024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
103952024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103962024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103972024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103982024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103992024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104002024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104012024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104022024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104032024-11-27T18:44:01.725ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
104042024-11-27T18:44:01.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104052024-11-27T18:44:01.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104062024-11-27T18:44:01.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104072024-11-27T18:44:01.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f02fcb5b-a8fa-4ce8-b4e3-c0fd9b253d6d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
104082024-11-27T18:44:01.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104092024-11-27T18:44:01.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e976ad32-4c47-4c4a-a8b6-d1b76d453706", "content-length": "52", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
104102024-11-27T18:44:01.728ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
104112024-11-27T18:44:01.728ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104122024-11-27T18:44:01.769ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104132024-11-27T18:44:01.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83c3bb74-6608-4e9d-90e6-69db15b7336a", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
104142024-11-27T18:44:01.830ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
104152024-11-27T18:44:01.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104162024-11-27T18:44:01.831ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2d1ce4b-35de-4339-a7c3-cfdb48021dfe", "content-length": "682", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
104172024-11-27T18:44:01.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104182024-11-27T18:44:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104192024-11-27T18:44:01.831ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce37335f-6f93-47c7-8eea-38073a1f784d", "content-length": "691", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
104202024-11-27T18:44:01.831ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
104212024-11-27T18:44:01.831ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
104222024-11-27T18:44:01.831ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
104232024-11-27T18:44:01.833ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.289136ms iteration = 20 status = {}
104242024-11-27T18:44:01.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104252024-11-27T18:44:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104262024-11-27T18:44:01.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104272024-11-27T18:44:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104282024-11-27T18:44:01.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104292024-11-27T18:44:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104302024-11-27T18:44:01.853ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.590627ms iteration = 20 status = {}
104312024-11-27T18:44:02.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4edcd3b9-7b57-47b0-8c98-7ba678ad18f4 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104322024-11-27T18:44:02.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4edcd3b9-7b57-47b0-8c98-7ba678ad18f4 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104332024-11-27T18:44:02.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 4edcd3b9-7b57-47b0-8c98-7ba678ad18f4 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104342024-11-27T18:44:02.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = cf1595b0-fc20-49db-9b2d-28d59b693355 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
104352024-11-27T18:44:02.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = cf1595b0-fc20-49db-9b2d-28d59b693355 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
104362024-11-27T18:44:02.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = cf1595b0-fc20-49db-9b2d-28d59b693355 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
104372024-11-27T18:44:03.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 4bf26036-13f9-4330-8982-35604823ca35 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
104382024-11-27T18:44:03.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46fb13e1-c933-43f5-a590-567dacb2c807 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104392024-11-27T18:44:03.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46fb13e1-c933-43f5-a590-567dacb2c807 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104402024-11-27T18:44:03.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 46fb13e1-c933-43f5-a590-567dacb2c807 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104412024-11-27T18:44:04.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 64d0b965-c1a8-4316-b3ab-3ba30a7989cc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104422024-11-27T18:44:04.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 64d0b965-c1a8-4316-b3ab-3ba30a7989cc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104432024-11-27T18:44:04.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 64d0b965-c1a8-4316-b3ab-3ba30a7989cc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104442024-11-27T18:44:05.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6614be5f-0109-47c9-9114-d716c1cf2768 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104452024-11-27T18:44:05.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6614be5f-0109-47c9-9114-d716c1cf2768 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104462024-11-27T18:44:05.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 6614be5f-0109-47c9-9114-d716c1cf2768 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104472024-11-27T18:44:06.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea8bf5a8-85ac-410b-a6be-dca19a52c45e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104482024-11-27T18:44:06.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea8bf5a8-85ac-410b-a6be-dca19a52c45e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104492024-11-27T18:44:06.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ea8bf5a8-85ac-410b-a6be-dca19a52c45e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104502024-11-27T18:44:07.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 479d4550-fb14-4e0d-a728-c80f6016a3d3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104512024-11-27T18:44:07.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 479d4550-fb14-4e0d-a728-c80f6016a3d3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104522024-11-27T18:44:07.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 479d4550-fb14-4e0d-a728-c80f6016a3d3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104532024-11-27T18:44:08.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f9221a-691f-4862-922c-4f41272f29c8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104542024-11-27T18:44:08.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f9221a-691f-4862-922c-4f41272f29c8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104552024-11-27T18:44:08.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d8f9221a-691f-4862-922c-4f41272f29c8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104562024-11-27T18:44:09.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a57d6d1d-7e82-4f66-8811-22c8cc0005e2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104572024-11-27T18:44:09.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a57d6d1d-7e82-4f66-8811-22c8cc0005e2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104582024-11-27T18:44:09.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a57d6d1d-7e82-4f66-8811-22c8cc0005e2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104592024-11-27T18:44:10.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c53e1c8f-16d1-4ce7-8df4-b075b27f3bd2 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104602024-11-27T18:44:10.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c53e1c8f-16d1-4ce7-8df4-b075b27f3bd2 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104612024-11-27T18:44:10.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = c53e1c8f-16d1-4ce7-8df4-b075b27f3bd2 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104622024-11-27T18:44:11.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
104632024-11-27T18:44:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104642024-11-27T18:44:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104652024-11-27T18:44:11.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
104662024-11-27T18:44:11.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104672024-11-27T18:44:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104682024-11-27T18:44:11.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104692024-11-27T18:44:11.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104702024-11-27T18:44:11.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104712024-11-27T18:44:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104722024-11-27T18:44:11.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104732024-11-27T18:44:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104742024-11-27T18:44:11.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104752024-11-27T18:44:11.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104762024-11-27T18:44:11.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104772024-11-27T18:44:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
104782024-11-27T18:44:11.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104792024-11-27T18:44:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104802024-11-27T18:44:11.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
104812024-11-27T18:44:11.444ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.751517ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
104822024-11-27T18:44:11.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.847276ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104832024-11-27T18:44:11.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b716589-6a54-45b2-8632-987cfda9ff5c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104842024-11-27T18:44:11.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b716589-6a54-45b2-8632-987cfda9ff5c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104852024-11-27T18:44:11.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7b716589-6a54-45b2-8632-987cfda9ff5c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104862024-11-27T18:44:12.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0997bf0-1e87-4cd9-a179-3f4f8201e381 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104872024-11-27T18:44:12.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0997bf0-1e87-4cd9-a179-3f4f8201e381 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104882024-11-27T18:44:12.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b0997bf0-1e87-4cd9-a179-3f4f8201e381 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104892024-11-27T18:44:13.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 834 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 07afd082-33f6-4e22-a632-584178b4518e response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
104902024-11-27T18:44:13.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 43ed6ca4-582d-4b1e-b857-bfaed2cf5416 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104912024-11-27T18:44:13.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 43ed6ca4-582d-4b1e-b857-bfaed2cf5416 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104922024-11-27T18:44:13.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 43ed6ca4-582d-4b1e-b857-bfaed2cf5416 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104932024-11-27T18:44:14.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab799f4c-91a0-4363-9382-f9f71fa04467 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104942024-11-27T18:44:14.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab799f4c-91a0-4363-9382-f9f71fa04467 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104952024-11-27T18:44:14.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = ab799f4c-91a0-4363-9382-f9f71fa04467 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104962024-11-27T18:44:15.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 184f1fde-bc97-4176-ba4d-10323c8eb888 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104972024-11-27T18:44:15.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 184f1fde-bc97-4176-ba4d-10323c8eb888 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104982024-11-27T18:44:15.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 184f1fde-bc97-4176-ba4d-10323c8eb888 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
104992024-11-27T18:44:16.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93c3c6e1-07a9-4281-97a1-fa6e22eb29fc roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105002024-11-27T18:44:16.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93c3c6e1-07a9-4281-97a1-fa6e22eb29fc resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105012024-11-27T18:44:16.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 93c3c6e1-07a9-4281-97a1-fa6e22eb29fc response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105022024-11-27T18:44:17.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 461d20df-eb92-42a6-96a4-61ab8c078b80 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105032024-11-27T18:44:17.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 461d20df-eb92-42a6-96a4-61ab8c078b80 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105042024-11-27T18:44:17.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 461d20df-eb92-42a6-96a4-61ab8c078b80 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105052024-11-27T18:44:18.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd3e658a-b940-4d39-982d-482307ca6824 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105062024-11-27T18:44:18.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd3e658a-b940-4d39-982d-482307ca6824 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105072024-11-27T18:44:18.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fd3e658a-b940-4d39-982d-482307ca6824 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105082024-11-27T18:44:19.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d78f8781-929b-4aac-a6b1-4c48224027b5 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105092024-11-27T18:44:19.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d78f8781-929b-4aac-a6b1-4c48224027b5 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105102024-11-27T18:44:19.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d78f8781-929b-4aac-a6b1-4c48224027b5 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105112024-11-27T18:44:20.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a4468615-4f1a-4855-8433-edf56b9e2daa roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105122024-11-27T18:44:20.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a4468615-4f1a-4855-8433-edf56b9e2daa resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105132024-11-27T18:44:20.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a4468615-4f1a-4855-8433-edf56b9e2daa response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105142024-11-27T18:44:21.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
105152024-11-27T18:44:21.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105162024-11-27T18:44:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105172024-11-27T18:44:21.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
105182024-11-27T18:44:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105192024-11-27T18:44:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105202024-11-27T18:44:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105212024-11-27T18:44:21.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105222024-11-27T18:44:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105232024-11-27T18:44:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105242024-11-27T18:44:21.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105252024-11-27T18:44:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105262024-11-27T18:44:21.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105272024-11-27T18:44:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105282024-11-27T18:44:21.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105292024-11-27T18:44:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
105302024-11-27T18:44:21.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105312024-11-27T18:44:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105322024-11-27T18:44:21.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
105332024-11-27T18:44:21.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.012106ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
105342024-11-27T18:44:21.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.662174ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105352024-11-27T18:44:21.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97b844de-2131-4539-999d-4616cb8dc91e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105362024-11-27T18:44:21.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97b844de-2131-4539-999d-4616cb8dc91e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105372024-11-27T18:44:21.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 97b844de-2131-4539-999d-4616cb8dc91e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105382024-11-27T18:44:23.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2cfde3c-d0b1-4254-af90-6ea360c9c1c8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105392024-11-27T18:44:23.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2cfde3c-d0b1-4254-af90-6ea360c9c1c8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105402024-11-27T18:44:23.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = b2cfde3c-d0b1-4254-af90-6ea360c9c1c8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105412024-11-27T18:44:23.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 671 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 43b11cb9-b230-42d8-9228-0f0e165965fd response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
105422024-11-27T18:44:24.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c04f50e-8fa4-4529-8942-e0870019a92a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105432024-11-27T18:44:24.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c04f50e-8fa4-4529-8942-e0870019a92a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105442024-11-27T18:44:24.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9c04f50e-8fa4-4529-8942-e0870019a92a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105452024-11-27T18:44:25.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76cdc75b-d968-4347-90c5-ba259aba1b2c roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105462024-11-27T18:44:25.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76cdc75b-d968-4347-90c5-ba259aba1b2c resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105472024-11-27T18:44:25.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 76cdc75b-d968-4347-90c5-ba259aba1b2c response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105482024-11-27T18:44:26.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d70958b0-26d9-4379-a21c-a629f930ceef roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105492024-11-27T18:44:26.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d70958b0-26d9-4379-a21c-a629f930ceef resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105502024-11-27T18:44:26.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d70958b0-26d9-4379-a21c-a629f930ceef response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105512024-11-27T18:44:27.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f2a7d36-93dc-4f31-9c1c-fb2cdfc43f9d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105522024-11-27T18:44:27.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f2a7d36-93dc-4f31-9c1c-fb2cdfc43f9d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105532024-11-27T18:44:27.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5f2a7d36-93dc-4f31-9c1c-fb2cdfc43f9d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105542024-11-27T18:44:28.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5da5a87-38c8-4e0e-9ff1-a46110638ad0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105552024-11-27T18:44:28.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5da5a87-38c8-4e0e-9ff1-a46110638ad0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105562024-11-27T18:44:28.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a5da5a87-38c8-4e0e-9ff1-a46110638ad0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105572024-11-27T18:44:29.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dde9a179-a4d7-40cd-bcb0-f92def072b21 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105582024-11-27T18:44:29.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dde9a179-a4d7-40cd-bcb0-f92def072b21 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105592024-11-27T18:44:29.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dde9a179-a4d7-40cd-bcb0-f92def072b21 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105602024-11-27T18:44:30.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44f79662-fd00-4b4e-90f4-487c00ef295e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105612024-11-27T18:44:30.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44f79662-fd00-4b4e-90f4-487c00ef295e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105622024-11-27T18:44:30.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 44f79662-fd00-4b4e-90f4-487c00ef295e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105632024-11-27T18:44:31.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d1afb652-e1fe-4ec7-acaf-b03c89cf5f19 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105642024-11-27T18:44:31.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d1afb652-e1fe-4ec7-acaf-b03c89cf5f19 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105652024-11-27T18:44:31.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = d1afb652-e1fe-4ec7-acaf-b03c89cf5f19 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
105662024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
105672024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
105682024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105692024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105702024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
105712024-11-27T18:44:31.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
105722024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.66\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
105732024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
105742024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
105752024-11-27T18:44:31.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105762024-11-27T18:44:31.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:34:31.392649920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105772024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
105782024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105792024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105802024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105812024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
105822024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
105832024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105842024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
105852024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105862024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105872024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
105882024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
105892024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
105902024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105912024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105922024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105932024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
105942024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
105952024-11-27T18:44:31.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105962024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
105972024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
105982024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105992024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106002024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
106012024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
106022024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
106032024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106042024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106052024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
106062024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
106072024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106082024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
106092024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
106102024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
106112024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106122024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
106132024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106142024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106152024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106162024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
106172024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106182024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
106192024-11-27T18:44:31.393ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
106202024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106212024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
106222024-11-27T18:44:31.393ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106232024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106242024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106252024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106262024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106272024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106282024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
106292024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
106302024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106312024-11-27T18:44:31.393ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
106322024-11-27T18:44:31.393ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
106332024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
106342024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106352024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
106362024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
106372024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
106382024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106392024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106402024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
106412024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106422024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106432024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106442024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106452024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106462024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106472024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106482024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106492024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106502024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106512024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106522024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106532024-11-27T18:44:31.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 389641034 } })
106542024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106552024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106562024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106572024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106582024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106592024-11-27T18:44:31.393ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
106602024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106612024-11-27T18:44:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106622024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106632024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106642024-11-27T18:44:31.394ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 389856237 } })
106652024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
106662024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.556453ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
106672024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
106682024-11-27T18:44:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.003585ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
106692024-11-27T18:44:31.395ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.037545ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
106702024-11-27T18:44:31.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106712024-11-27T18:44:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106722024-11-27T18:44:31.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106732024-11-27T18:44:31.396ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:34:31.392649920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106742024-11-27T18:44:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.170262ms iteration = 11 status = {"expiration":"2024-11-27T18:34:31.392649920Z","pruned":[]}
106752024-11-27T18:44:31.397ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.194172ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106762024-11-27T18:44:31.397ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106772024-11-27T18:44:31.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106782024-11-27T18:44:31.398ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106792024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106802024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106812024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106822024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106832024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106842024-11-27T18:44:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106852024-11-27T18:44:31.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106862024-11-27T18:44:31.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106872024-11-27T18:44:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106882024-11-27T18:44:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106892024-11-27T18:44:31.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106902024-11-27T18:44:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106912024-11-27T18:44:31.401ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106922024-11-27T18:44:31.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106932024-11-27T18:44:31.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942024-11-27T18:44:31.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106952024-11-27T18:44:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
106962024-11-27T18:44:31.403ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106972024-11-27T18:44:31.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106982024-11-27T18:44:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106992024-11-27T18:44:31.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107002024-11-27T18:44:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107012024-11-27T18:44:31.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107022024-11-27T18:44:31.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 402904811 } })
107032024-11-27T18:44:31.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107042024-11-27T18:44:31.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
107052024-11-27T18:44:31.407ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107062024-11-27T18:44:31.407ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107072024-11-27T18:44:31.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107082024-11-27T18:44:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107092024-11-27T18:44:31.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107102024-11-27T18:44:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107112024-11-27T18:44:31.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107122024-11-27T18:44:31.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107132024-11-27T18:44:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107142024-11-27T18:44:31.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107152024-11-27T18:44:31.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107162024-11-27T18:44:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107172024-11-27T18:44:31.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107182024-11-27T18:44:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107192024-11-27T18:44:31.412ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 407842844 } })
107202024-11-27T18:44:31.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
107212024-11-27T18:44:31.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107222024-11-27T18:44:31.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107232024-11-27T18:44:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107242024-11-27T18:44:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107252024-11-27T18:44:31.415ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107262024-11-27T18:44:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107272024-11-27T18:44:31.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107282024-11-27T18:44:31.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107292024-11-27T18:44:31.418ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107302024-11-27T18:44:31.418ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107312024-11-27T18:44:31.418ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107322024-11-27T18:44:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107332024-11-27T18:44:31.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107342024-11-27T18:44:31.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107352024-11-27T18:44:31.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 421487846 } })
107362024-11-27T18:44:31.425ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
107372024-11-27T18:44:31.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107382024-11-27T18:44:31.427ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(b845cb2a-c1b0-4e85-86db-5319430db8f0, 0), (13f59999-9c86-4dfc-a124-b6c19f1b3024, 0), (64504a1c-7931-4bfd-b548-bce7e883eb71, 0), (2be03475-eba6-49d5-8d88-f99c929a0c6f, 0)] collection_id = b845cb2a-c1b0-4e85-86db-5319430db8f0
107392024-11-27T18:44:31.427ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107402024-11-27T18:44:31.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107412024-11-27T18:44:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107422024-11-27T18:44:31.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107432024-11-27T18:44:31.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.376013ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
107442024-11-27T18:44:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
107452024-11-27T18:44:31.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107462024-11-27T18:44:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107472024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107482024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107492024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107502024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107512024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107522024-11-27T18:44:31.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107532024-11-27T18:44:31.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107542024-11-27T18:44:31.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107552024-11-27T18:44:31.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107562024-11-27T18:44:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107572024-11-27T18:44:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
107582024-11-27T18:44:31.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107592024-11-27T18:44:31.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107602024-11-27T18:44:31.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107612024-11-27T18:44:31.447ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107622024-11-27T18:44:31.447ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107632024-11-27T18:44:31.447ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 54.463718ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107642024-11-27T18:44:31.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107652024-11-27T18:44:31.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.914508ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
107662024-11-27T18:44:31.450ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107672024-11-27T18:44:31.450ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107682024-11-27T18:44:31.450ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.399421ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107692024-11-27T18:44:31.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107702024-11-27T18:44:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107712024-11-27T18:44:31.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107722024-11-27T18:44:31.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107732024-11-27T18:44:31.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107742024-11-27T18:44:31.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107752024-11-27T18:44:31.461ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
107762024-11-27T18:44:31.461ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
107772024-11-27T18:44:31.461ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.80982ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107782024-11-27T18:44:31.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107792024-11-27T18:44:31.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107802024-11-27T18:44:31.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107812024-11-27T18:44:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107822024-11-27T18:44:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107832024-11-27T18:44:31.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107842024-11-27T18:44:31.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107852024-11-27T18:44:31.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107862024-11-27T18:44:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107872024-11-27T18:44:31.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107882024-11-27T18:44:31.466ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107892024-11-27T18:44:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107902024-11-27T18:44:31.466ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
107912024-11-27T18:44:31.466ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.851114ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
107922024-11-27T18:44:31.467ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
107932024-11-27T18:44:31.467ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 74.160309ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
107942024-11-27T18:44:31.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107952024-11-27T18:44:31.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107962024-11-27T18:44:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107972024-11-27T18:44:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107982024-11-27T18:44:31.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.600256ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107992024-11-27T18:44:31.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108002024-11-27T18:44:31.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108012024-11-27T18:44:31.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108022024-11-27T18:44:31.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108032024-11-27T18:44:31.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108042024-11-27T18:44:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108052024-11-27T18:44:31.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108062024-11-27T18:44:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108072024-11-27T18:44:31.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108082024-11-27T18:44:31.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108092024-11-27T18:44:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108102024-11-27T18:44:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
108112024-11-27T18:44:31.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108122024-11-27T18:44:31.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108132024-11-27T18:44:31.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108142024-11-27T18:44:31.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108152024-11-27T18:44:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108162024-11-27T18:44:31.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108172024-11-27T18:44:31.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108182024-11-27T18:44:31.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108192024-11-27T18:44:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
108202024-11-27T18:44:31.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108212024-11-27T18:44:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108222024-11-27T18:44:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108232024-11-27T18:44:31.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108242024-11-27T18:44:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108252024-11-27T18:44:31.489ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.751875ms iteration = 21 status = 0
108262024-11-27T18:44:31.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108272024-11-27T18:44:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108282024-11-27T18:44:31.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108292024-11-27T18:44:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108302024-11-27T18:44:31.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108312024-11-27T18:44:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108322024-11-27T18:44:31.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108332024-11-27T18:44:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108342024-11-27T18:44:31.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108352024-11-27T18:44:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108362024-11-27T18:44:31.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108372024-11-27T18:44:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108382024-11-27T18:44:31.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108392024-11-27T18:44:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108402024-11-27T18:44:31.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108412024-11-27T18:44:31.501ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
108422024-11-27T18:44:31.501ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
108432024-11-27T18:44:31.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108442024-11-27T18:44:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108452024-11-27T18:44:31.502ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = b845cb2a-c1b0-4e85-86db-5319430db8f0 file = nexus/db-queries/src/db/datastore/inventory.rs:1452 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
108462024-11-27T18:44:31.502ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108472024-11-27T18:44:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108482024-11-27T18:44:31.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.584794ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
108492024-11-27T18:44:31.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108502024-11-27T18:44:31.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108512024-11-27T18:44:31.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.824918ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108522024-11-27T18:44:31.503ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108532024-11-27T18:44:31.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108542024-11-27T18:44:31.503ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108552024-11-27T18:44:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108562024-11-27T18:44:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108572024-11-27T18:44:31.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108582024-11-27T18:44:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108592024-11-27T18:44:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.356516ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108602024-11-27T18:44:31.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.37369ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
108612024-11-27T18:44:31.506ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(13f59999-9c86-4dfc-a124-b6c19f1b3024, 0), (64504a1c-7931-4bfd-b548-bce7e883eb71, 0), (2be03475-eba6-49d5-8d88-f99c929a0c6f, 0)]
108622024-11-27T18:44:31.506ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 502749271 } })
108632024-11-27T18:44:31.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108642024-11-27T18:44:31.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108652024-11-27T18:44:31.508ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
108662024-11-27T18:44:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 115.627324ms iteration = 11 status = {"generation":1}
108672024-11-27T18:44:31.520ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
108682024-11-27T18:44:31.520ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
108692024-11-27T18:44:31.520ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
108702024-11-27T18:44:31.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108712024-11-27T18:44:31.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108722024-11-27T18:44:31.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
108732024-11-27T18:44:31.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108742024-11-27T18:44:31.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108752024-11-27T18:44:31.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108762024-11-27T18:44:31.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108772024-11-27T18:44:31.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108782024-11-27T18:44:31.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108792024-11-27T18:44:31.543ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108802024-11-27T18:44:31.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108812024-11-27T18:44:31.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108822024-11-27T18:44:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108832024-11-27T18:44:31.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108842024-11-27T18:44:31.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108852024-11-27T18:44:31.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108862024-11-27T18:44:31.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108872024-11-27T18:44:31.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108882024-11-27T18:44:31.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108892024-11-27T18:44:31.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108902024-11-27T18:44:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108912024-11-27T18:44:31.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108922024-11-27T18:44:31.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108932024-11-27T18:44:31.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108942024-11-27T18:44:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108952024-11-27T18:44:31.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108962024-11-27T18:44:31.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108972024-11-27T18:44:31.558ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
108982024-11-27T18:44:31.558ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 165.338751ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
108992024-11-27T18:44:31.561ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
109002024-11-27T18:44:31.561ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
109012024-11-27T18:44:31.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109022024-11-27T18:44:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109032024-11-27T18:44:31.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109042024-11-27T18:44:31.566ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.763326ms iteration = 23 status = {"physical_disks_added":0}
109052024-11-27T18:44:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109062024-11-27T18:44:31.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109072024-11-27T18:44:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109082024-11-27T18:44:31.568ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
109092024-11-27T18:44:31.568ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
109102024-11-27T18:44:31.568ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
109112024-11-27T18:44:31.568ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 175.680524ms iteration = 11 status = {"generation":2}
109122024-11-27T18:44:31.576ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
109132024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 184.066078ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
109142024-11-27T18:44:31.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109152024-11-27T18:44:31.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109162024-11-27T18:44:31.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109172024-11-27T18:44:31.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109182024-11-27T18:44:31.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109192024-11-27T18:44:31.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109202024-11-27T18:44:31.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109212024-11-27T18:44:31.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109222024-11-27T18:44:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109232024-11-27T18:44:31.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109242024-11-27T18:44:31.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109252024-11-27T18:44:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109262024-11-27T18:44:31.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109272024-11-27T18:44:31.595ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109282024-11-27T18:44:31.595ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81c2ee6b-137b-44e3-bf7c-e962e7729fca", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
109292024-11-27T18:44:31.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109302024-11-27T18:44:31.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109312024-11-27T18:44:31.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109322024-11-27T18:44:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109332024-11-27T18:44:31.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109342024-11-27T18:44:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109352024-11-27T18:44:31.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109362024-11-27T18:44:31.608ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109372024-11-27T18:44:31.608ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109382024-11-27T18:44:31.609ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa8e60c8-4f49-4e44-8c3e-c5da958edc0a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
109392024-11-27T18:44:31.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109402024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109412024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109422024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109432024-11-27T18:44:31.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
109442024-11-27T18:44:31.610ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109452024-11-27T18:44:31.611ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f5a015-b5f7-497f-9081-9078676c0b19", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
109462024-11-27T18:44:31.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109472024-11-27T18:44:31.611ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109482024-11-27T18:44:31.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
109492024-11-27T18:44:31.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109502024-11-27T18:44:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109512024-11-27T18:44:31.625ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109522024-11-27T18:44:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109532024-11-27T18:44:31.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109542024-11-27T18:44:31.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109552024-11-27T18:44:31.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109562024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109572024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109582024-11-27T18:44:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109592024-11-27T18:44:31.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109602024-11-27T18:44:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109612024-11-27T18:44:31.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109622024-11-27T18:44:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109632024-11-27T18:44:31.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109642024-11-27T18:44:31.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109652024-11-27T18:44:31.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109662024-11-27T18:44:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109672024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109682024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109692024-11-27T18:44:31.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109702024-11-27T18:44:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109712024-11-27T18:44:31.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109722024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109732024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109742024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109752024-11-27T18:44:31.671ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
109762024-11-27T18:44:31.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109772024-11-27T18:44:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109782024-11-27T18:44:31.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109792024-11-27T18:44:31.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109802024-11-27T18:44:31.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109812024-11-27T18:44:31.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109822024-11-27T18:44:31.680ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109832024-11-27T18:44:31.680ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109842024-11-27T18:44:31.680ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109852024-11-27T18:44:31.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
109862024-11-27T18:44:31.742ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109872024-11-27T18:44:31.742ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109882024-11-27T18:44:31.742ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ec6953-b413-4107-aaa7-50c6c655e5bb", "content-length": "372", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
109892024-11-27T18:44:31.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109902024-11-27T18:44:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109912024-11-27T18:44:31.764ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
109922024-11-27T18:44:31.764ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109932024-11-27T18:44:31.765ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e1806e21-d1f8-4811-a9f8-54a829b05595", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
109942024-11-27T18:44:31.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109952024-11-27T18:44:31.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109962024-11-27T18:44:31.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109972024-11-27T18:44:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109982024-11-27T18:44:31.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109992024-11-27T18:44:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110002024-11-27T18:44:31.776ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110012024-11-27T18:44:31.776ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110022024-11-27T18:44:31.777ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e72d30b-a163-4a04-b673-a1e5a7927f7c", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110032024-11-27T18:44:31.778ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.461523ms iteration = 21 status = {}
110042024-11-27T18:44:31.795ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110052024-11-27T18:44:31.795ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1693d5c1-9a20-48c0-a6b4-3a3bd59787e4", "content-length": "1", "date": "Wed, 27 Nov 2024 18:44:30 GMT"} })
110062024-11-27T18:44:31.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110072024-11-27T18:44:31.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110082024-11-27T18:44:31.808ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110092024-11-27T18:44:31.808ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110102024-11-27T18:44:31.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110112024-11-27T18:44:31.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110122024-11-27T18:44:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.565968ms iteration = 21 status = {}
110132024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
110142024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
110152024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
110162024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
110172024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "432372d2-02df-4d7b-8b95-b048c43ef1b6", "content-length": "476", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110182024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
110192024-11-27T18:44:31.872ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f12393cc-8a10-4a07-bebe-794ac9e57692", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110202024-11-27T18:44:31.872ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110212024-11-27T18:44:31.874ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110222024-11-27T18:44:31.874ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f54aaa-ed34-4192-95df-4b28aff1a052", "content-length": "734", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110232024-11-27T18:44:31.874ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
110242024-11-27T18:44:31.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0937125b-c32e-4e67-9e5c-8d94f5adcaf8", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110252024-11-27T18:44:31.874ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110262024-11-27T18:44:31.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "972d2bf4-0c94-4bb4-92d6-7bccb315a57d", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110272024-11-27T18:44:31.874ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110282024-11-27T18:44:31.876ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ca039037-c0ae-4b8f-9167-f7c5274abfe6", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110292024-11-27T18:44:31.876ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "347fbe0b-d409-4748-8ca9-c7761ddfd8f3", "content-length": "111", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110302024-11-27T18:44:31.876ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110312024-11-27T18:44:31.876ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
110322024-11-27T18:44:31.876ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110332024-11-27T18:44:31.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 484.006954ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
110342024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1332cb2-a183-4a53-8aea-62edf64dbd77", "content-length": "111", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110352024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
110362024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dc0254e-6668-461f-accc-a22da9cace1f", "content-length": "167", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110372024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
110382024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ba7e8a-a790-41b0-8558-5eb6a0354ed1", "content-length": "167", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110392024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
110402024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b43ba2-4779-4e5f-ada5-1f7ba03d204d", "content-length": "175", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110412024-11-27T18:44:31.877ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
110422024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0025e55-4edf-4123-adc6-75955c34aeb5", "content-length": "175", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110432024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
110442024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d6fa143-5278-4aec-a545-065f5cc7f1d2", "content-length": "702", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110452024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110462024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ecc5c7-56be-4682-91a9-a65d0f4e7a78", "content-length": "727", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110472024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110482024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ef56fab-9fce-48d7-985d-c81c25918dd3", "content-length": "729", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110492024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110502024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3fdf74a-5575-41aa-ab69-22b7edffb938", "content-length": "728", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110512024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
110522024-11-27T18:44:31.878ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21e5b988-0100-44ae-bee2-d720129c9d85", "content-length": "722", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110532024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
110542024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c5e89d6f-ceff-45fa-a792-d81b03698564", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110552024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d506abde-4664-4cf9-9ceb-7b8bfee827c4", "content-length": "109", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110562024-11-27T18:44:31.879ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110572024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
110582024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f2efd7b-01d2-422b-bfe2-ffebfc9a1119", "content-length": "109", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110592024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
110602024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1df4dd8b-bc0f-4e1b-83bb-fddc76e83ee4", "content-length": "169", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110612024-11-27T18:44:31.879ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
110622024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0c9d31-16fc-4bef-bc63-b8cba39e304d", "content-length": "169", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110632024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
110642024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c141738-1de1-4ac0-9a07-5dc64c322f28", "content-length": "178", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110652024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
110662024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97c003c0-14ca-4b5c-bc25-48b89dcf82a7", "content-length": "178", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110672024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
110682024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f707a60f-53ed-4666-86cd-800732cff610", "content-length": "702", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110692024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110702024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a09ae053-0f7d-4c6f-b7c3-c16d6a8fae46", "content-length": "727", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110712024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110722024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "629e5a5f-2731-4edf-b661-86f79754112f", "content-length": "729", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110732024-11-27T18:44:31.880ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110742024-11-27T18:44:31.881ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2e5fd94-6f31-4cbc-b713-e73da0c1357e", "content-length": "728", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110752024-11-27T18:44:31.881ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110762024-11-27T18:44:31.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110772024-11-27T18:44:31.881ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
110782024-11-27T18:44:31.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 488.757033ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110792024-11-27T18:44:31.884ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110802024-11-27T18:44:31.884ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2b5ca7a-9703-41b4-8e82-94cd35c429e9", "content-length": "691", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
110812024-11-27T18:44:31.884ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
110822024-11-27T18:44:31.884ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
110832024-11-27T18:44:31.884ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
110842024-11-27T18:44:31.886ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.26103ms iteration = 21 status = {}
110852024-11-27T18:44:31.886ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 492.845835ms iteration = 21 status = null
110862024-11-27T18:44:31.887ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110872024-11-27T18:44:31.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110882024-11-27T18:44:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110892024-11-27T18:44:31.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
110902024-11-27T18:44:31.889ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110912024-11-27T18:44:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110922024-11-27T18:44:31.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110932024-11-27T18:44:31.917ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110942024-11-27T18:44:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
110952024-11-27T18:44:31.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
110962024-11-27T18:44:31.919ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110972024-11-27T18:44:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110982024-11-27T18:44:31.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110992024-11-27T18:44:31.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111002024-11-27T18:44:31.947ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
111012024-11-27T18:44:31.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111022024-11-27T18:44:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111032024-11-27T18:44:31.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111042024-11-27T18:44:31.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd33fe9-55f1-4b7d-ad5b-73e1739c6461", "content-length": "134", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
111052024-11-27T18:44:31.960ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111062024-11-27T18:44:31.960ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
111072024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111082024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111092024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111102024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111112024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111122024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111132024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111142024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111152024-11-27T18:44:31.961ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
111162024-11-27T18:44:31.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111172024-11-27T18:44:31.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111182024-11-27T18:44:31.963ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
111192024-11-27T18:44:31.963ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "613f1a04-3c20-4e95-bcf6-057bdcfe6f35", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
111202024-11-27T18:44:31.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
111212024-11-27T18:44:31.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa04981e-7871-4589-9abe-27e732ac537f", "content-length": "2", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
111222024-11-27T18:44:31.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
111232024-11-27T18:44:31.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb372952-7ebf-40df-a2f7-253d85aa1602", "content-length": "52", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
111242024-11-27T18:44:31.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
111252024-11-27T18:44:31.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111262024-11-27T18:44:31.965ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
111272024-11-27T18:44:31.965ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 572.884311ms
111282024-11-27T18:44:31.965ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 572.896651ms iteration = 3 status = {}
111292024-11-27T18:44:32.028ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
111302024-11-27T18:44:32.028ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
111312024-11-27T18:44:32.093ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0754abd9-693e-4005-ab8b-84fef813bf67", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
111322024-11-27T18:44:32.093ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
111332024-11-27T18:44:32.093ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
111342024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "59aff8cb-db87-469e-afcc-f8a55f04c57d", "content-length": "682", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
111352024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111362024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111372024-11-27T18:44:32.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111382024-11-27T18:44:32.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111392024-11-27T18:44:32.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111402024-11-27T18:44:32.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111412024-11-27T18:44:32.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111422024-11-27T18:44:32.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111432024-11-27T18:44:32.114ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 721.544375ms iteration = 21 status = {}
111442024-11-27T18:44:32.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e036c75a-3cf4-456e-9d15-6a201f73c4e6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111452024-11-27T18:44:32.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e036c75a-3cf4-456e-9d15-6a201f73c4e6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111462024-11-27T18:44:32.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = e036c75a-3cf4-456e-9d15-6a201f73c4e6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111472024-11-27T18:44:32.382ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a806857a-1449-4e00-8915-b06cdad68f1f", "content-length": "30797", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
111482024-11-27T18:44:32.384ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111492024-11-27T18:44:32.384ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111502024-11-27T18:44:32.384ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
111512024-11-27T18:44:32.386ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111522024-11-27T18:44:32.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111532024-11-27T18:44:32.416ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111542024-11-27T18:44:32.418ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111552024-11-27T18:44:32.418ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111562024-11-27T18:44:32.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111572024-11-27T18:44:32.602ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 197a0b29-9794-4349-b21b-1cb75973d30e file = nexus/db-queries/src/db/datastore/inventory.rs:1006
111582024-11-27T18:44:32.602ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 197a0b29-9794-4349-b21b-1cb75973d30e time_started = 2024-11-27 18:44:31.872234 UTC
111592024-11-27T18:44:32.602ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.209903174s iteration = 3 status = {"collection_id":"197a0b29-9794-4349-b21b-1cb75973d30e","time_done":"2024-11-27 18:44:32.384421 UTC","time_started":"2024-11-27 18:44:31.872234 UTC"}
111602024-11-27T18:44:32.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
111612024-11-27T18:44:32.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111622024-11-27T18:44:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111632024-11-27T18:44:32.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111642024-11-27T18:44:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111652024-11-27T18:44:32.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111662024-11-27T18:44:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111672024-11-27T18:44:32.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111682024-11-27T18:44:32.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111692024-11-27T18:44:32.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111702024-11-27T18:44:32.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111712024-11-27T18:44:32.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111722024-11-27T18:44:32.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111732024-11-27T18:44:32.714ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.881038ms iteration = 24 status = {"physical_disks_added":0}
111742024-11-27T18:44:32.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ad2de8c7-4a1f-4309-aaec-fffaa378524b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
111752024-11-27T18:44:32.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ad2de8c7-4a1f-4309-aaec-fffaa378524b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
111762024-11-27T18:44:32.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44726 req_id = ad2de8c7-4a1f-4309-aaec-fffaa378524b response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
111772024-11-27T18:44:33.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a33976c0-e6be-491e-acdd-808ff22d25d6 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111782024-11-27T18:44:33.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a33976c0-e6be-491e-acdd-808ff22d25d6 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111792024-11-27T18:44:33.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a33976c0-e6be-491e-acdd-808ff22d25d6 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111802024-11-27T18:44:33.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = 1f443a81-f7f4-4a15-a6cd-3c38a1f336a1 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
111812024-11-27T18:44:34.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1d55bc-e095-4be1-b169-88fa5078a433 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111822024-11-27T18:44:34.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1d55bc-e095-4be1-b169-88fa5078a433 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111832024-11-27T18:44:34.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd1d55bc-e095-4be1-b169-88fa5078a433 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111842024-11-27T18:44:35.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4821892-42a4-43aa-ba40-5c51138ff40e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111852024-11-27T18:44:35.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4821892-42a4-43aa-ba40-5c51138ff40e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111862024-11-27T18:44:35.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4821892-42a4-43aa-ba40-5c51138ff40e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111872024-11-27T18:44:36.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50dceaee-52b7-413b-b617-f9157d090c7b roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111882024-11-27T18:44:36.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50dceaee-52b7-413b-b617-f9157d090c7b resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111892024-11-27T18:44:36.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 50dceaee-52b7-413b-b617-f9157d090c7b response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111902024-11-27T18:44:37.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4058ea4-9ba3-4051-8925-7c1926309fd1 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111912024-11-27T18:44:37.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4058ea4-9ba3-4051-8925-7c1926309fd1 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111922024-11-27T18:44:37.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f4058ea4-9ba3-4051-8925-7c1926309fd1 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111932024-11-27T18:44:38.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 00961c10-cf82-4614-970c-42b7428d3d66 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111942024-11-27T18:44:38.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 00961c10-cf82-4614-970c-42b7428d3d66 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111952024-11-27T18:44:38.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 00961c10-cf82-4614-970c-42b7428d3d66 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111962024-11-27T18:44:39.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12a41b6b-8a12-45b6-8935-22533b3e3854 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111972024-11-27T18:44:39.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12a41b6b-8a12-45b6-8935-22533b3e3854 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111982024-11-27T18:44:39.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 12a41b6b-8a12-45b6-8935-22533b3e3854 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
111992024-11-27T18:44:40.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a354a18c-a7ff-45a7-9df7-2ab368d4e3e0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112002024-11-27T18:44:40.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a354a18c-a7ff-45a7-9df7-2ab368d4e3e0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112012024-11-27T18:44:40.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a354a18c-a7ff-45a7-9df7-2ab368d4e3e0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112022024-11-27T18:44:41.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
112032024-11-27T18:44:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112042024-11-27T18:44:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112052024-11-27T18:44:41.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
112062024-11-27T18:44:41.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112072024-11-27T18:44:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112082024-11-27T18:44:41.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112092024-11-27T18:44:41.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f3a262-543c-4df0-b478-03a3aa1145ce roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112102024-11-27T18:44:41.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f3a262-543c-4df0-b478-03a3aa1145ce resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112112024-11-27T18:44:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112122024-11-27T18:44:41.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112132024-11-27T18:44:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112142024-11-27T18:44:41.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = f1f3a262-543c-4df0-b478-03a3aa1145ce response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112152024-11-27T18:44:41.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112162024-11-27T18:44:41.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112172024-11-27T18:44:41.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112182024-11-27T18:44:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
112192024-11-27T18:44:41.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112202024-11-27T18:44:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112212024-11-27T18:44:41.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
112222024-11-27T18:44:41.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.166928ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
112232024-11-27T18:44:41.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112242024-11-27T18:44:41.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112252024-11-27T18:44:41.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.954134ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112262024-11-27T18:44:42.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 98a9e26b-89da-46e5-bde7-13eb7d55059a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112272024-11-27T18:44:42.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 98a9e26b-89da-46e5-bde7-13eb7d55059a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112282024-11-27T18:44:42.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 98a9e26b-89da-46e5-bde7-13eb7d55059a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112292024-11-27T18:44:43.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cad6d97e-f4d2-430b-9aa7-bdd715bea047 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112302024-11-27T18:44:43.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cad6d97e-f4d2-430b-9aa7-bdd715bea047 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112312024-11-27T18:44:43.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cad6d97e-f4d2-430b-9aa7-bdd715bea047 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112322024-11-27T18:44:43.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = ddc9e602-7718-49bd-a700-8b40755503cc response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
112332024-11-27T18:44:44.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03a2e680-854f-4a48-8275-2433909a7ccd roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112342024-11-27T18:44:44.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03a2e680-854f-4a48-8275-2433909a7ccd resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112352024-11-27T18:44:44.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 03a2e680-854f-4a48-8275-2433909a7ccd response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112362024-11-27T18:44:45.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d2f4c26-fd86-4f48-b97c-3f222fdde09e roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112372024-11-27T18:44:45.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d2f4c26-fd86-4f48-b97c-3f222fdde09e resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112382024-11-27T18:44:45.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 3d2f4c26-fd86-4f48-b97c-3f222fdde09e response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112392024-11-27T18:44:46.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7de09d7-a12f-4aee-8faa-38dad51cea63 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112402024-11-27T18:44:46.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7de09d7-a12f-4aee-8faa-38dad51cea63 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112412024-11-27T18:44:46.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = a7de09d7-a12f-4aee-8faa-38dad51cea63 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112422024-11-27T18:44:47.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5ef7a1a4-148e-4c77-9f38-2e15aa439438 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112432024-11-27T18:44:47.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5ef7a1a4-148e-4c77-9f38-2e15aa439438 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112442024-11-27T18:44:47.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 5ef7a1a4-148e-4c77-9f38-2e15aa439438 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112452024-11-27T18:44:48.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1bfc8bfa-139d-4153-a980-902121353cdf roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112462024-11-27T18:44:48.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1bfc8bfa-139d-4153-a980-902121353cdf resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112472024-11-27T18:44:48.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 1bfc8bfa-139d-4153-a980-902121353cdf response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112482024-11-27T18:44:49.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc2cbabd-c937-4215-abb0-7a64630e895a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112492024-11-27T18:44:49.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc2cbabd-c937-4215-abb0-7a64630e895a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112502024-11-27T18:44:49.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dc2cbabd-c937-4215-abb0-7a64630e895a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112512024-11-27T18:44:50.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfc265b4-a912-4ec4-96ae-cc145483f3e8 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112522024-11-27T18:44:50.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfc265b4-a912-4ec4-96ae-cc145483f3e8 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112532024-11-27T18:44:50.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = dfc265b4-a912-4ec4-96ae-cc145483f3e8 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112542024-11-27T18:44:51.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
112552024-11-27T18:44:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112562024-11-27T18:44:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112572024-11-27T18:44:51.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
112582024-11-27T18:44:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112592024-11-27T18:44:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112602024-11-27T18:44:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112612024-11-27T18:44:51.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112622024-11-27T18:44:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112632024-11-27T18:44:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112642024-11-27T18:44:51.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112652024-11-27T18:44:51.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.479057ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112662024-11-27T18:44:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112672024-11-27T18:44:51.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112682024-11-27T18:44:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112692024-11-27T18:44:51.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112702024-11-27T18:44:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
112712024-11-27T18:44:51.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112722024-11-27T18:44:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112732024-11-27T18:44:51.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
112742024-11-27T18:44:51.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.431813ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
112752024-11-27T18:44:51.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52a35608-049f-4817-aa8a-cb82480753d0 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112762024-11-27T18:44:51.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52a35608-049f-4817-aa8a-cb82480753d0 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112772024-11-27T18:44:51.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52a35608-049f-4817-aa8a-cb82480753d0 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112782024-11-27T18:44:52.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 22c8e393-1929-48c1-9003-4fd04eb25417 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112792024-11-27T18:44:52.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 22c8e393-1929-48c1-9003-4fd04eb25417 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112802024-11-27T18:44:52.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 22c8e393-1929-48c1-9003-4fd04eb25417 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112812024-11-27T18:44:53.584ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::b]:56027 method = GET remote_addr = [fd00:1122:3344:101::d]:38545 req_id = dc7c4bac-3722-4d2c-8485-ec73d3f7c5c8 response_code = 200 uri = /236c7b74-8315-46e3-9a37-90380a675558
112822024-11-27T18:44:53.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd789afb-f754-4adc-98d5-d63b266d2832 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112832024-11-27T18:44:53.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd789afb-f754-4adc-98d5-d63b266d2832 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112842024-11-27T18:44:53.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = cd789afb-f754-4adc-98d5-d63b266d2832 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112852024-11-27T18:44:54.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52dcf532-93cf-457e-9dec-3e734e9c32ed roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112862024-11-27T18:44:54.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52dcf532-93cf-457e-9dec-3e734e9c32ed resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112872024-11-27T18:44:54.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52dcf532-93cf-457e-9dec-3e734e9c32ed response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112882024-11-27T18:44:55.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb6fa169-b291-4385-be67-2a84e948701d roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112892024-11-27T18:44:55.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb6fa169-b291-4385-be67-2a84e948701d resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112902024-11-27T18:44:55.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = fb6fa169-b291-4385-be67-2a84e948701d response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112912024-11-27T18:44:56.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9d548020-6937-4faf-98b0-60dc426e3246 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112922024-11-27T18:44:56.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9d548020-6937-4faf-98b0-60dc426e3246 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112932024-11-27T18:44:56.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 9d548020-6937-4faf-98b0-60dc426e3246 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112942024-11-27T18:44:57.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13ab5d9d-99fc-41e9-9f37-a3be4ba4939a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112952024-11-27T18:44:57.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13ab5d9d-99fc-41e9-9f37-a3be4ba4939a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112962024-11-27T18:44:57.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 13ab5d9d-99fc-41e9-9f37-a3be4ba4939a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112972024-11-27T18:44:58.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16d45854-30c7-467e-b052-fc2116f74c31 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112982024-11-27T18:44:58.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16d45854-30c7-467e-b052-fc2116f74c31 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
112992024-11-27T18:44:58.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 16d45854-30c7-467e-b052-fc2116f74c31 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113002024-11-27T18:44:59.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52128345-25a6-42f9-8661-48a34b4cc177 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113012024-11-27T18:44:59.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52128345-25a6-42f9-8661-48a34b4cc177 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113022024-11-27T18:44:59.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 52128345-25a6-42f9-8661-48a34b4cc177 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113032024-11-27T18:45:00.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2ef9b1ce-dde1-439f-a2c2-e1007a32b07a roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113042024-11-27T18:45:00.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2ef9b1ce-dde1-439f-a2c2-e1007a32b07a resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113052024-11-27T18:45:00.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 2ef9b1ce-dde1-439f-a2c2-e1007a32b07a response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
113062024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
113072024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
113082024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113092024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
113102024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113112024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
113122024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
113132024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
113142024-11-27T18:45:01.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113152024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113162024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113172024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113182024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
113192024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113202024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
113212024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113222024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
113232024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113242024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
113252024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113262024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
113272024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113282024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113292024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
113302024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113312024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
113322024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113332024-11-27T18:45:01.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
113342024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113352024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113362024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113372024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113382024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113392024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113402024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113412024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113422024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113432024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
113442024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113452024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113462024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113472024-11-27T18:45:01.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113482024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
113492024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
113502024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113512024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113522024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
113532024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113542024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113552024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113562024-11-27T18:45:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113572024-11-27T18:45:01.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113582024-11-27T18:45:01.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113592024-11-27T18:45:01.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113602024-11-27T18:45:01.398ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.401461ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113612024-11-27T18:45:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113622024-11-27T18:45:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113632024-11-27T18:45:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113642024-11-27T18:45:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113652024-11-27T18:45:01.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113662024-11-27T18:45:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113672024-11-27T18:45:01.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113682024-11-27T18:45:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113692024-11-27T18:45:01.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113702024-11-27T18:45:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113712024-11-27T18:45:01.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113722024-11-27T18:45:01.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113732024-11-27T18:45:01.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113742024-11-27T18:45:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113752024-11-27T18:45:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113762024-11-27T18:45:01.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113772024-11-27T18:45:01.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113782024-11-27T18:45:01.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2735, tv_nsec: 402145700 } })
113792024-11-27T18:45:01.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
113802024-11-27T18:45:01.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113812024-11-27T18:45:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113822024-11-27T18:45:01.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113832024-11-27T18:45:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113842024-11-27T18:45:01.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113852024-11-27T18:45:01.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2735, tv_nsec: 411359266 } })
113862024-11-27T18:45:01.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
113872024-11-27T18:45:01.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113882024-11-27T18:45:01.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2735, tv_nsec: 411927595 } })
113892024-11-27T18:45:01.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
113902024-11-27T18:45:01.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113912024-11-27T18:45:01.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113922024-11-27T18:45:01.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113932024-11-27T18:45:01.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113942024-11-27T18:45:01.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113952024-11-27T18:45:01.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113962024-11-27T18:45:01.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113972024-11-27T18:45:01.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113982024-11-27T18:45:01.447ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113992024-11-27T18:45:01.447ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114002024-11-27T18:45:01.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114012024-11-27T18:45:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114022024-11-27T18:45:01.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.069081ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
114032024-11-27T18:45:01.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.460817ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
114042024-11-27T18:45:01.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114052024-11-27T18:45:01.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114062024-11-27T18:45:01.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114072024-11-27T18:45:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114082024-11-27T18:45:01.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114092024-11-27T18:45:01.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114102024-11-27T18:45:01.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114112024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114122024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114132024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114142024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114152024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114162024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
114172024-11-27T18:45:01.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114182024-11-27T18:45:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114192024-11-27T18:45:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114202024-11-27T18:45:01.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114212024-11-27T18:45:01.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114222024-11-27T18:45:01.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114232024-11-27T18:45:01.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114242024-11-27T18:45:01.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114252024-11-27T18:45:01.464ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.042708ms iteration = 22 status = 0
114262024-11-27T18:45:01.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.849ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114272024-11-27T18:45:01.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
114282024-11-27T18:45:01.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114292024-11-27T18:45:01.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114302024-11-27T18:45:01.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
114312024-11-27T18:45:01.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.499502ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
114322024-11-27T18:45:01.486ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114332024-11-27T18:45:01.486ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
114342024-11-27T18:45:01.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114352024-11-27T18:45:01.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114362024-11-27T18:45:01.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114372024-11-27T18:45:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114382024-11-27T18:45:01.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.693312ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
114392024-11-27T18:45:01.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114402024-11-27T18:45:01.497ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114412024-11-27T18:45:01.498ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5cb6df9-d9f5-4ec9-a037-f6060aea01e0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114422024-11-27T18:45:01.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114432024-11-27T18:45:01.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.507514ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114442024-11-27T18:45:01.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114452024-11-27T18:45:01.508ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
114462024-11-27T18:45:01.508ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.377505ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
114472024-11-27T18:45:01.529ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
114482024-11-27T18:45:01.529ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114492024-11-27T18:45:01.529ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "844e1420-f25f-418c-96df-93217ddc1520", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114502024-11-27T18:45:01.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114512024-11-27T18:45:01.531ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
114522024-11-27T18:45:01.535ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114532024-11-27T18:45:01.535ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114542024-11-27T18:45:01.535ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d63c83-49f6-40d4-aa42-f70bfc853e3a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114552024-11-27T18:45:01.535ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114562024-11-27T18:45:01.537ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114572024-11-27T18:45:01.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114582024-11-27T18:45:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114592024-11-27T18:45:01.556ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.981101ms iteration = 25 status = {"physical_disks_added":0}
114602024-11-27T18:45:01.582ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114612024-11-27T18:45:01.582ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114622024-11-27T18:45:01.583ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b78ecc-13d6-4e2e-ba76-1f560a749ad2", "content-length": "372", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114632024-11-27T18:45:01.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114642024-11-27T18:45:01.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114652024-11-27T18:45:01.619ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.65988ms iteration = 22 status = {}
114662024-11-27T18:45:01.635ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114672024-11-27T18:45:01.635ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
114682024-11-27T18:45:01.635ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 242.846579ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
114692024-11-27T18:45:01.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 243.716183ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
114702024-11-27T18:45:01.653ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
114712024-11-27T18:45:01.653ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114722024-11-27T18:45:01.653ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c98b8418-d6d7-4cf1-9825-9d2e3afa4626", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114732024-11-27T18:45:01.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114742024-11-27T18:45:01.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114752024-11-27T18:45:01.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114762024-11-27T18:45:01.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114772024-11-27T18:45:01.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114782024-11-27T18:45:01.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114792024-11-27T18:45:01.663ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114802024-11-27T18:45:01.663ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114812024-11-27T18:45:01.664ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86255285-ed69-4f86-95a6-5c69a2a5df2d", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114822024-11-27T18:45:01.665ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.041597ms iteration = 22 status = {}
114832024-11-27T18:45:01.712ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
114842024-11-27T18:45:01.712ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "639ca3e6-6d16-4a99-8c1f-0420ad083ba6", "content-length": "1", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
114852024-11-27T18:45:01.714ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114862024-11-27T18:45:01.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114872024-11-27T18:45:01.717ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.685383ms iteration = 22 status = null
114882024-11-27T18:45:01.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114892024-11-27T18:45:01.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114902024-11-27T18:45:01.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114912024-11-27T18:45:01.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114922024-11-27T18:45:01.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114932024-11-27T18:45:01.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114942024-11-27T18:45:01.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114952024-11-27T18:45:01.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114962024-11-27T18:45:01.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114972024-11-27T18:45:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114982024-11-27T18:45:01.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114992024-11-27T18:45:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115002024-11-27T18:45:01.794ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
115012024-11-27T18:45:01.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115022024-11-27T18:45:01.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115032024-11-27T18:45:01.807ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115042024-11-27T18:45:01.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "064015ad-8eee-4680-a10d-b5a54881f811", "content-length": "134", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115052024-11-27T18:45:01.807ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115062024-11-27T18:45:01.807ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
115072024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115082024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115092024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115102024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115112024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115122024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115132024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115142024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115152024-11-27T18:45:01.808ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
115162024-11-27T18:45:01.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115172024-11-27T18:45:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115182024-11-27T18:45:01.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115192024-11-27T18:45:01.811ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "19dc531b-f9de-4d77-9a9e-7e7790bcae4a", "content-length": "2", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115202024-11-27T18:45:01.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115212024-11-27T18:45:01.811ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "60f58f1c-113a-48c5-ab17-f8f7ab8092dd", "content-length": "52", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115222024-11-27T18:45:01.811ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
115232024-11-27T18:45:01.811ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115242024-11-27T18:45:01.864ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115252024-11-27T18:45:01.969ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "49e4190f-f3ab-4cec-9df6-ae840b4a277f", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115262024-11-27T18:45:01.969ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
115272024-11-27T18:45:01.969ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115282024-11-27T18:45:01.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7fbf1930-3250-4d01-bc31-77ab830217c3 roles = RoleSet { roles: {} } uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
115292024-11-27T18:45:01.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7fbf1930-3250-4d01-bc31-77ab830217c3 resource = Database result = Ok(()) uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
115302024-11-27T18:45:01.970ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f127bbd3-6523-4035-a428-e3f358ab7aa2", "content-length": "691", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115312024-11-27T18:45:01.970ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2116a1d5-1a68-437f-a1a6-304b3993cddc", "content-length": "682", "date": "Wed, 27 Nov 2024 18:45:01 GMT"} })
115322024-11-27T18:45:01.970ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
115332024-11-27T18:45:01.970ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
115342024-11-27T18:45:01.970ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
115352024-11-27T18:45:01.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115362024-11-27T18:45:01.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115372024-11-27T18:45:01.971ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 579.149154ms iteration = 22 status = {}
115382024-11-27T18:45:01.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51666 req_id = 7fbf1930-3250-4d01-bc31-77ab830217c3 response_code = 200 uri = /probes/b844cfb5-ff43-41f6-a61d-f7949f48466b
115392024-11-27T18:45:01.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115402024-11-27T18:45:01.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115412024-11-27T18:45:01.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115422024-11-27T18:45:01.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115432024-11-27T18:45:01.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115442024-11-27T18:45:01.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115452024-11-27T18:45:02.001ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 608.394737ms iteration = 22 status = {}