Max level shown:
1 [ Nov 18 21:00:51 Enabled. ]
2 [ Nov 18 21:00:51 Rereading configuration. ]
3 [ Nov 18 21:00:54 Rereading configuration. ]
4 [ Nov 18 21:01:03 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 18 21:01:03 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-18T21:01:03.314ZDEBGnexus: registered DTrace probes
82024-11-18T21:01:03.316ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-18T21:01:03.326ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-18T21:01:03.327ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-18T21:01:03.327ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-18T21:01:03.343ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-18T21:01:03.345ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-18T21:01:03.349ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-18T21:01:03.356ZDEBGnexus (ServerContext): registered USDT probes
672024-11-18T21:01:03.462ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-18T21:01:03.465ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
692024-11-18T21:01:03.465ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 788099769 } })
702024-11-18T21:01:03.465ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
712024-11-18T21:01:03.518ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
722024-11-18T21:01:03.518ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-18T21:01:03.526ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38ab8c3f-4cd7-4609-8f4a-d3b10395c64a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:03 GMT"} })
742024-11-18T21:01:03.526ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-18T21:01:03.526ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-18T21:01:03.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 880723200 } })
772024-11-18T21:01:03.558ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
782024-11-18T21:01:03.590ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
792024-11-18T21:01:03.590ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-18T21:01:03.590ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d32a6fe-d07f-49a0-b7db-c6f3750fa020", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:03 GMT"} })
812024-11-18T21:01:03.590ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-18T21:01:03.591ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-18T21:01:03.661ZDEBGnexus (clickhouse-client): registered USDT probes id = a7e65ae9-af2b-4c2d-acdf-326e0beded00
842024-11-18T21:01:03.661ZDEBGnexus (clickhouse-client): registered USDT probes id = a7e65ae9-af2b-4c2d-acdf-326e0beded00
852024-11-18T21:01:03.668ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-18T21:01:03.682ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-18T21:01:03.684ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-18T21:01:03.684ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-18T21:01:03.684ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
912024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
922024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
932024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
942024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
952024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
962024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
972024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
982024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
992024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1002024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1012024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1022024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1032024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1042024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1062024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1072024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1082024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1092024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1102024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1112024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1122024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1132024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1142024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1152024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1162024-11-18T21:01:03.696ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1172024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1182024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1192024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1202024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1212024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1222024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1232024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1242024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1252024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1262024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1272024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1282024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1292024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1302024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1312024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1322024-11-18T21:01:03.697ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1332024-11-18T21:01:03.697ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1342024-11-18T21:01:03.697ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-18T21:01:03.697ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-18T21:01:03.732ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-18T21:01:03.732ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-18T21:01:03.733ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-18T21:01:03.733ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-18T21:01:03.733ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-18T21:01:03.733ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-18T21:01:03.762ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-18T21:01:03.762ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-18T21:01:03.763ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-18T21:01:03.763ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-18T21:01:03.763ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-18T21:01:03.763ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-18T21:01:03.780ZWARNnexus: Cannot look up rack: Object (of type ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3)) not found: rack file = nexus/src/app/rack.rs:774
1492024-11-18T21:01:04.279ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1502024-11-18T21:01:04.279ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-18T21:01:04.281ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-18T21:01:04.281ZDEBGnexus (DataLoader): attempting to create built-in silos
1532024-11-18T21:01:04.281ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-11-18T21:01:04.281ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-11-18T21:01:04.360ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1562024-11-18T21:01:04.360ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-11-18T21:01:04.361ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-11-18T21:01:04.417ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-11-18T21:01:04.418ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-11-18T21:01:04.418ZDEBGnexus (DataLoader): attempting to create built-in projects
1612024-11-18T21:01:04.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-11-18T21:01:04.418ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-11-18T21:01:04.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-18T21:01:04.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-18T21:01:04.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-18T21:01:04.929ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-18T21:01:04.960ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-11-18T21:01:04.962ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1692024-11-18T21:01:04.962ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-11-18T21:01:04.962ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712024-11-18T21:01:04.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-11-18T21:01:04.965ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-11-18T21:01:04.966ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-18T21:01:04.968ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752024-11-18T21:01:04.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-11-18T21:01:04.968ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-11-18T21:01:05.023ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1782024-11-18T21:01:05.023ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-18T21:01:05.025ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-18T21:01:05.025ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1812024-11-18T21:01:05.025ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-18T21:01:05.025ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-11-18T21:01:05.045ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-11-18T21:01:05.046ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-11-18T21:01:05.058ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-18T21:01:05.058ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-18T21:01:05.060ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-11-18T21:01:05.060ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-11-18T21:01:05.061ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-18T21:01:05.062ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-18T21:01:05.100ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-18T21:01:05.103ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-11-18T21:01:05.103ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-18T21:01:05.104ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-11-18T21:01:05.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-18T21:01:05.145ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-18T21:01:05.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-11-18T21:01:05.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-11-18T21:01:05.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-11-18T21:01:05.151ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2012024-11-18T21:01:05.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-18T21:01:05.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-18T21:01:05.192ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-11-18T21:01:05.192ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-11-18T21:01:05.194ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-18T21:01:05.194ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-11-18T21:01:05.195ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-18T21:01:05.196ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-18T21:01:05.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-18T21:01:05.201ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2112024-11-18T21:01:05.201ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-18T21:01:05.201ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-11-18T21:01:05.218ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-18T21:01:05.218ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-18T21:01:05.235ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-11-18T21:01:05.235ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-11-18T21:01:05.252ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-11-18T21:01:05.252ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-11-18T21:01:05.254ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-18T21:01:05.254ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-11-18T21:01:05.255ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-18T21:01:05.256ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-11-18T21:01:05.257ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-18T21:01:05.261ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2252024-11-18T21:01:05.261ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-18T21:01:05.261ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-18T21:01:05.312ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-18T21:01:05.312ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-11-18T21:01:05.314ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-18T21:01:05.314ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-11-18T21:01:05.317ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-18T21:01:05.317ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-18T21:01:05.319ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-18T21:01:05.323ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2352024-11-18T21:01:05.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-18T21:01:05.323ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-11-18T21:01:05.396ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-11-18T21:01:05.396ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-11-18T21:01:05.398ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-18T21:01:05.398ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-18T21:01:05.400ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-11-18T21:01:05.400ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-11-18T21:01:05.402ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-11-18T21:01:05.407ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2452024-11-18T21:01:05.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-11-18T21:01:05.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-11-18T21:01:05.506ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2482024-11-18T21:01:05.506ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-11-18T21:01:05.506ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502024-11-18T21:01:05.510ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-11-18T21:01:05.510ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-11-18T21:01:05.513ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-11-18T21:01:05.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-11-18T21:01:05.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-11-18T21:01:05.518ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-11-18T21:01:05.523ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-11-18T21:01:05.523ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-11-18T21:01:05.525ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-18T21:01:05.525ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-11-18T21:01:05.527ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-18T21:01:05.531ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2622024-11-18T21:01:05.531ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-11-18T21:01:05.531ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-11-18T21:01:05.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-11-18T21:01:05.533ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-11-18T21:01:05.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-11-18T21:01:05.535ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-11-18T21:01:05.537ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-11-18T21:01:05.541ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2702024-11-18T21:01:05.541ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-11-18T21:01:05.541ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722024-11-18T21:01:05.565ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-11-18T21:01:05.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-11-18T21:01:05.566ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-11-18T21:01:05.567ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-11-18T21:01:05.568ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-11-18T21:01:05.568ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-11-18T21:01:05.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-11-18T21:01:05.573ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2802024-11-18T21:01:05.573ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-11-18T21:01:05.573ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-11-18T21:01:05.693ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2832024-11-18T21:01:05.693ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2842024-11-18T21:01:05.693ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-11-18T21:01:05.693ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-11-18T21:01:05.710ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-18T21:01:05.710ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-18T21:01:05.711ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-18T21:01:05.712ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-11-18T21:01:05.714ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-18T21:01:05.714ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-18T21:01:05.716ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-11-18T21:01:05.716ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-11-18T21:01:05.717ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-18T21:01:05.717ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-18T21:01:05.719ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-18T21:01:05.721ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2982024-11-18T21:01:05.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-18T21:01:05.722ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-18T21:01:05.724ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-18T21:01:05.724ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-18T21:01:05.728ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-18T21:01:05.729ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-18T21:01:05.730ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-18T21:01:05.730ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-18T21:01:05.733ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-18T21:01:05.736ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3082024-11-18T21:01:05.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-18T21:01:05.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-18T21:01:05.775ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-18T21:01:05.776ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-18T21:01:05.781ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-18T21:01:05.781ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-18T21:01:05.781ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3152024-11-18T21:01:05.781ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3162024-11-18T21:01:05.782ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-18T21:01:05.782ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-11-18T21:01:05.784ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-18T21:01:05.784ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-18T21:01:05.785ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-18T21:01:05.789ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3222024-11-18T21:01:05.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-18T21:01:05.789ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-18T21:01:05.846ZWARNnexus: Cannot look up rack: Object (of type ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3)) not found: rack file = nexus/src/app/rack.rs:774
3252024-11-18T21:01:05.885ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-11-18T21:01:05.885ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-11-18T21:01:05.887ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-11-18T21:01:05.887ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-11-18T21:01:05.890ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-11-18T21:01:05.890ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-11-18T21:01:05.892ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-11-18T21:01:05.892ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332024-11-18T21:01:05.893ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-11-18T21:01:05.893ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-11-18T21:01:05.895ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-11-18T21:01:05.895ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-11-18T21:01:05.897ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-11-18T21:01:05.897ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-11-18T21:01:05.898ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-11-18T21:01:05.902ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3412024-11-18T21:01:05.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-11-18T21:01:05.902ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-11-18T21:01:05.904ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442024-11-18T21:01:05.904ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3452024-11-18T21:01:05.905ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-11-18T21:01:05.905ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-11-18T21:01:05.907ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482024-11-18T21:01:05.907ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492024-11-18T21:01:05.908ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-11-18T21:01:05.911ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3512024-11-18T21:01:05.925ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-11-18T21:01:05.925ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532024-11-18T21:01:05.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-11-18T21:01:05.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-11-18T21:01:05.954ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562024-11-18T21:01:05.954ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3572024-11-18T21:01:05.955ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-11-18T21:01:05.956ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3592024-11-18T21:01:05.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602024-11-18T21:01:05.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612024-11-18T21:01:05.958ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-11-18T21:01:05.962ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3632024-11-18T21:01:05.962ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-11-18T21:01:05.962ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652024-11-18T21:01:05.971ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3662024-11-18T21:01:05.971ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3672024-11-18T21:01:05.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682024-11-18T21:01:05.972ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692024-11-18T21:01:05.972ZDEBGnexus (DataLoader): attempting to create silo users
3702024-11-18T21:01:05.972ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-11-18T21:01:05.972ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-11-18T21:01:05.976ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3732024-11-18T21:01:05.976ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3742024-11-18T21:01:05.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-11-18T21:01:05.977ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3762024-11-18T21:01:05.985ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3772024-11-18T21:01:05.985ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782024-11-18T21:01:05.985ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792024-11-18T21:01:05.990ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-11-18T21:01:05.990ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812024-11-18T21:01:05.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822024-11-18T21:01:05.998ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832024-11-18T21:01:06.000ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-11-18T21:01:06.001ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3852024-11-18T21:01:06.001ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-11-18T21:01:06.001ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3872024-11-18T21:01:06.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3882024-11-18T21:01:06.006ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3892024-11-18T21:01:06.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902024-11-18T21:01:06.008ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3912024-11-18T21:01:06.008ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922024-11-18T21:01:06.009ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932024-11-18T21:01:06.202ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942024-11-18T21:01:06.203ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952024-11-18T21:01:06.227ZINFOnexus: populate complete file = nexus/src/app/mod.rs:555
3962024-11-18T21:01:06.227ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:564
3972024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3982024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3992024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4002024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4012024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4022024-11-18T21:01:06.231ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4032024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4042024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4052024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4062024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4072024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4082024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4092024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4102024-11-18T21:01:06.231ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4112024-11-18T21:01:06.231ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:51:06.231355802 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4122024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4132024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4142024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4152024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4162024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4172024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4182024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4192024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4202024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4212024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4222024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4232024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4242024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4252024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4262024-11-18T21:01:06.231ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4272024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4282024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4292024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4302024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4312024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4322024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4332024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4342024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4352024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4362024-11-18T21:01:06.231ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4372024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4382024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4392024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4402024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4412024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4422024-11-18T21:01:06.231ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4432024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4442024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4452024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4462024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4472024-11-18T21:01:06.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4482024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4492024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4502024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4512024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4522024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4532024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4542024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4552024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4562024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 891.267\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4572024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 220.002\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4582024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 135.241\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4592024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 917.997\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4602024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4612024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4622024-11-18T21:01:06.232ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4632024-11-18T21:01:06.232ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4642024-11-18T21:01:06.232ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4652024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4662024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4672024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4682024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4692024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4702024-11-18T21:01:06.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4712024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4722024-11-18T21:01:06.236ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4732024-11-18T21:01:06.236ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4742024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4752024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4762024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4772024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4782024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4792024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4802024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4812024-11-18T21:01:06.236ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 975, tv_nsec: 558763072 } })
4822024-11-18T21:01:06.236ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 975, tv_nsec: 558766192 } })
4832024-11-18T21:01:06.236ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4842024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.823414ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4852024-11-18T21:01:06.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4862024-11-18T21:01:06.237ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4872024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.55\u{b5}s iteration = 2 status = {"error":"no config"}
4882024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.32062ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4892024-11-18T21:01:06.237ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4902024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.150766ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4912024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4922024-11-18T21:01:06.237ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4932024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.08\u{b5}s iteration = 2 status = {"error":"no config"}
4942024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4952024-11-18T21:01:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4962024-11-18T21:01:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4972024-11-18T21:01:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4982024-11-18T21:01:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4992024-11-18T21:01:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5002024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5012024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5022024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5032024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5042024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5062024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5072024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5082024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5092024-11-18T21:01:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5102024-11-18T21:01:06.240ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5112024-11-18T21:01:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5122024-11-18T21:01:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5132024-11-18T21:01:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5142024-11-18T21:01:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5152024-11-18T21:01:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5162024-11-18T21:01:06.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5172024-11-18T21:01:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5182024-11-18T21:01:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5192024-11-18T21:01:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5202024-11-18T21:01:06.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5212024-11-18T21:01:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5222024-11-18T21:01:06.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232024-11-18T21:01:06.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 975, tv_nsec: 569260131 } })
5242024-11-18T21:01:06.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5252024-11-18T21:01:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5262024-11-18T21:01:06.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5272024-11-18T21:01:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5282024-11-18T21:01:06.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5292024-11-18T21:01:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5302024-11-18T21:01:06.250ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:51:06.231355802 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5312024-11-18T21:01:06.250ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.468245ms iteration = 1 status = {"expiration":"2024-11-18T20:51:06.231355802Z","pruned":[]}
5322024-11-18T21:01:06.280ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332024-11-18T21:01:06.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.383216ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5342024-11-18T21:01:06.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.554594ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5352024-11-18T21:01:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5362024-11-18T21:01:06.283ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5372024-11-18T21:01:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5382024-11-18T21:01:06.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5392024-11-18T21:01:06.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 975, tv_nsec: 610574919 } })
5402024-11-18T21:01:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5412024-11-18T21:01:06.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5422024-11-18T21:01:06.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5432024-11-18T21:01:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5442024-11-18T21:01:06.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5452024-11-18T21:01:06.291ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
5462024-11-18T21:01:06.291ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5472024-11-18T21:01:06.291ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9de01bd9-721e-4bba-89e6-69054e47c656", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
5482024-11-18T21:01:06.293ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 62.116164ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5492024-11-18T21:01:06.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-11-18T21:01:06.294ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5512024-11-18T21:01:06.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5522024-11-18T21:01:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5532024-11-18T21:01:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5542024-11-18T21:01:06.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5552024-11-18T21:01:06.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5562024-11-18T21:01:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5572024-11-18T21:01:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5582024-11-18T21:01:06.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-11-18T21:01:06.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5602024-11-18T21:01:06.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-11-18T21:01:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5622024-11-18T21:01:06.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-18T21:01:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5642024-11-18T21:01:06.305ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5652024-11-18T21:01:06.305ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5662024-11-18T21:01:06.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5672024-11-18T21:01:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5682024-11-18T21:01:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5692024-11-18T21:01:06.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5702024-11-18T21:01:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5712024-11-18T21:01:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5722024-11-18T21:01:06.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5732024-11-18T21:01:06.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5742024-11-18T21:01:06.308ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
5752024-11-18T21:01:06.308ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 76.42433ms iteration = 1 status = {"error":"rack not yet initialized: f35dae23-a43a-4d77-a204-fab3c4bdfff3"}
5762024-11-18T21:01:06.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-11-18T21:01:06.308ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(df8f78cd-5531-431c-9652-c966cfe78b20, 0)]
5782024-11-18T21:01:06.308ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 77.044515ms iteration = 1 status = {}
5792024-11-18T21:01:06.309ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 975, tv_nsec: 632070619 } })
5802024-11-18T21:01:06.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5812024-11-18T21:01:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5822024-11-18T21:01:06.310ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5832024-11-18T21:01:06.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.174793ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5842024-11-18T21:01:06.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5852024-11-18T21:01:06.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5862024-11-18T21:01:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5872024-11-18T21:01:06.311ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5882024-11-18T21:01:06.311ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5892024-11-18T21:01:06.311ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.842895ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5902024-11-18T21:01:06.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5912024-11-18T21:01:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5922024-11-18T21:01:06.318ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5932024-11-18T21:01:06.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-11-18T21:01:06.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5952024-11-18T21:01:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5962024-11-18T21:01:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5972024-11-18T21:01:06.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5982024-11-18T21:01:06.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992024-11-18T21:01:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6002024-11-18T21:01:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012024-11-18T21:01:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6022024-11-18T21:01:06.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6032024-11-18T21:01:06.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6042024-11-18T21:01:06.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6052024-11-18T21:01:06.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6062024-11-18T21:01:06.324ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6072024-11-18T21:01:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6082024-11-18T21:01:06.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6092024-11-18T21:01:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6102024-11-18T21:01:06.328ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6112024-11-18T21:01:06.328ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 96.426639ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6122024-11-18T21:01:06.328ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132024-11-18T21:01:06.329ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6142024-11-18T21:01:06.329ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6152024-11-18T21:01:06.329ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.400847ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6162024-11-18T21:01:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6172024-11-18T21:01:06.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6182024-11-18T21:01:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6192024-11-18T21:01:06.347ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6202024-11-18T21:01:06.347ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.985015ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6212024-11-18T21:01:06.349ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
6222024-11-18T21:01:06.349ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.741348ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
6232024-11-18T21:01:06.349ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.308042ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6242024-11-18T21:01:06.359ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6252024-11-18T21:01:06.359ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6262024-11-18T21:01:06.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6272024-11-18T21:01:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6282024-11-18T21:01:06.365ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6292024-11-18T21:01:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.988559ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6302024-11-18T21:01:06.365ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6312024-11-18T21:01:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 134.310272ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6322024-11-18T21:01:06.369ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6332024-11-18T21:01:06.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6342024-11-18T21:01:06.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352024-11-18T21:01:06.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6362024-11-18T21:01:06.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6372024-11-18T21:01:06.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.373864ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6382024-11-18T21:01:06.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6392024-11-18T21:01:06.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402024-11-18T21:01:06.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6412024-11-18T21:01:06.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.734564ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6422024-11-18T21:01:06.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6432024-11-18T21:01:06.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6442024-11-18T21:01:06.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6452024-11-18T21:01:06.382ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6462024-11-18T21:01:06.382ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6472024-11-18T21:01:06.382ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42252c98-b565-4dc3-b3be-5b0bc1224883", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6482024-11-18T21:01:06.382ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6492024-11-18T21:01:06.382ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec0895ab-809a-4376-8ad7-ce90e6f8e3dd", "content-length": "1", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6502024-11-18T21:01:06.383ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6512024-11-18T21:01:06.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6522024-11-18T21:01:06.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6532024-11-18T21:01:06.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6542024-11-18T21:01:06.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6552024-11-18T21:01:06.390ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 158.976645ms iteration = 1 status = null
6562024-11-18T21:01:06.395ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6572024-11-18T21:01:06.395ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6582024-11-18T21:01:06.395ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6592024-11-18T21:01:06.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "02dd4ffa-1c68-447a-b8c5-5f6bd0e8a010", "content-length": "476", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6602024-11-18T21:01:06.398ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6612024-11-18T21:01:06.398ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4fc0169-10a2-40a9-8ba7-ca3eb42ddd56", "content-length": "734", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6622024-11-18T21:01:06.399ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6632024-11-18T21:01:06.399ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b161a57a-5bcc-4213-9c0d-a1933d721458", "content-length": "111", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6642024-11-18T21:01:06.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6652024-11-18T21:01:06.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3de5a863-bb7b-4e65-8764-189778721579", "content-length": "111", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6662024-11-18T21:01:06.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6672024-11-18T21:01:06.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "20f38bfb-f3d6-45b1-9fb3-e918aab77cfb", "content-length": "167", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6682024-11-18T21:01:06.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6692024-11-18T21:01:06.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b993210e-6d69-425c-8f72-68fcccf368c1", "content-length": "167", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6702024-11-18T21:01:06.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6712024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b189019f-0a61-470d-90cc-64234c6bd1cf", "content-length": "175", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6722024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6732024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8bc841d-9408-4dda-af5d-707cbdb041b6", "content-length": "175", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6742024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6752024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9a68e2-bcea-492e-815b-46d0ddeeb407", "content-length": "702", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6762024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6772024-11-18T21:01:06.402ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6782024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 171.850371ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6792024-11-18T21:01:06.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb792f4-514b-4b68-b575-e77e1813881c", "content-length": "727", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6802024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6812024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "65ab117b-e09b-4467-96b3-167a2cbc77bd", "content-length": "729", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6822024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6832024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b547ec-1f68-4f92-8b60-5b6e1f0d6fb4", "content-length": "728", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6842024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6852024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27282145-4c86-47c0-92fe-118a962a0602", "content-length": "722", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6862024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6872024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "12dcf58e-b5b9-40d2-9763-16aabf4ce9c6", "content-length": "109", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6882024-11-18T21:01:06.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6892024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e7d355f-5944-4e1c-b207-b62fa7ad2786", "content-length": "109", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6902024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6912024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11688cab-84a0-469b-be4b-ed2bf8d5c922", "content-length": "169", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6922024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6932024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa84cf3b-58a0-4757-a398-3b5cc6bc9249", "content-length": "169", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6942024-11-18T21:01:06.404ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6952024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5abba786-46aa-46cd-b342-7de7232d2b29", "content-length": "178", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6962024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6972024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "efd63563-6afb-40b9-8aa2-c427ebd6acc6", "content-length": "178", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
6982024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6992024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "15cb4d76-d48f-4e7e-9ae7-ec8ba56fcdb8", "content-length": "702", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
7002024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7012024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf2a1c3-59ec-4ad2-b7b2-5eec6996b794", "content-length": "727", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
7022024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7032024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a248c51a-1009-499d-a096-25d6b4cce5b6", "content-length": "729", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
7042024-11-18T21:01:06.405ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7052024-11-18T21:01:06.406ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ad6654-224d-42c3-a117-0680181d1b76", "content-length": "728", "date": "Mon, 18 Nov 2024 21:01:05 GMT"} })
7062024-11-18T21:01:06.406ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7072024-11-18T21:01:06.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7082024-11-18T21:01:06.407ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7092024-11-18T21:01:06.407ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7102024-11-18T21:01:06.407ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.677591ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7112024-11-18T21:01:06.407ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122024-11-18T21:01:06.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7132024-11-18T21:01:06.410ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7142024-11-18T21:01:06.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7152024-11-18T21:01:06.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 185.278122ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7162024-11-18T21:01:06.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7172024-11-18T21:01:06.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7182024-11-18T21:01:06.421ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.225748ms iteration = 1 status = {}
7192024-11-18T21:01:06.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-11-18T21:01:06.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7212024-11-18T21:01:06.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7222024-11-18T21:01:06.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7232024-11-18T21:01:06.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7242024-11-18T21:01:06.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7252024-11-18T21:01:06.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7262024-11-18T21:01:06.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7272024-11-18T21:01:06.432ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7282024-11-18T21:01:06.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7292024-11-18T21:01:06.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302024-11-18T21:01:06.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7312024-11-18T21:01:06.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-11-18T21:01:06.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-11-18T21:01:06.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7342024-11-18T21:01:06.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7352024-11-18T21:01:06.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7362024-11-18T21:01:06.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7372024-11-18T21:01:06.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-11-18T21:01:06.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-11-18T21:01:06.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-11-18T21:01:06.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-11-18T21:01:06.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422024-11-18T21:01:06.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7432024-11-18T21:01:06.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7442024-11-18T21:01:06.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7452024-11-18T21:01:06.452ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 220.881537ms iteration = 1 status = {}
7462024-11-18T21:01:06.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472024-11-18T21:01:06.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-18T21:01:06.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492024-11-18T21:01:06.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502024-11-18T21:01:06.458ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7512024-11-18T21:01:06.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522024-11-18T21:01:06.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7532024-11-18T21:01:06.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7542024-11-18T21:01:06.460ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7552024-11-18T21:01:06.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7562024-11-18T21:01:06.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7572024-11-18T21:01:06.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7582024-11-18T21:01:06.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7592024-11-18T21:01:06.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7602024-11-18T21:01:06.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7612024-11-18T21:01:06.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7622024-11-18T21:01:06.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7632024-11-18T21:01:06.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7642024-11-18T21:01:06.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7652024-11-18T21:01:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7662024-11-18T21:01:06.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7672024-11-18T21:01:06.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7682024-11-18T21:01:06.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7692024-11-18T21:01:06.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7702024-11-18T21:01:06.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7712024-11-18T21:01:06.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7722024-11-18T21:01:06.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7732024-11-18T21:01:06.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7742024-11-18T21:01:06.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7752024-11-18T21:01:06.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7762024-11-18T21:01:06.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7772024-11-18T21:01:06.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7782024-11-18T21:01:06.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7792024-11-18T21:01:06.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7802024-11-18T21:01:06.506ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7812024-11-18T21:01:06.506ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 275.211662ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7822024-11-18T21:01:06.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832024-11-18T21:01:06.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842024-11-18T21:01:06.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852024-11-18T21:01:06.529ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7862024-11-18T21:01:06.529ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7872024-11-18T21:01:06.529ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7882024-11-18T21:01:06.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7892024-11-18T21:01:06.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7902024-11-18T21:01:06.530ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7912024-11-18T21:01:06.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7922024-11-18T21:01:06.532ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7942024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7962024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7972024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7982024-11-18T21:01:06.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7992024-11-18T21:01:06.536ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8002024-11-18T21:01:06.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8012024-11-18T21:01:06.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8022024-11-18T21:01:06.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032024-11-18T21:01:06.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042024-11-18T21:01:06.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8052024-11-18T21:01:06.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8062024-11-18T21:01:06.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8072024-11-18T21:01:06.548ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8082024-11-18T21:01:06.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092024-11-18T21:01:06.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8102024-11-18T21:01:06.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112024-11-18T21:01:06.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8122024-11-18T21:01:06.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8132024-11-18T21:01:06.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8142024-11-18T21:01:06.563ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8152024-11-18T21:01:06.563ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8162024-11-18T21:01:06.563ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8172024-11-18T21:01:06.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8182024-11-18T21:01:06.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8192024-11-18T21:01:06.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-11-18T21:01:06.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8212024-11-18T21:01:06.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8222024-11-18T21:01:06.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8232024-11-18T21:01:06.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242024-11-18T21:01:06.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8252024-11-18T21:01:06.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8262024-11-18T21:01:06.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8272024-11-18T21:01:06.666ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 446e44f2-6d00-4404-b1cf-f0710c40cc2b file = nexus/db-queries/src/db/datastore/inventory.rs:1000
8282024-11-18T21:01:06.666ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 446e44f2-6d00-4404-b1cf-f0710c40cc2b time_started = 2024-11-18 21:01:06.395120 UTC
8292024-11-18T21:01:06.666ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 434.765342ms iteration = 1 status = {"collection_id":"446e44f2-6d00-4404-b1cf-f0710c40cc2b","time_done":"2024-11-18 21:01:06.529035 UTC","time_started":"2024-11-18 21:01:06.395120 UTC"}
8302024-11-18T21:01:06.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8312024-11-18T21:01:06.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8322024-11-18T21:01:06.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8332024-11-18T21:01:06.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 435.876171ms iteration = 1 status = {}
8342024-11-18T21:01:06.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352024-11-18T21:01:06.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8362024-11-18T21:01:06.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8372024-11-18T21:01:06.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8382024-11-18T21:01:06.672ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
8392024-11-18T21:01:06.672ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.039865ms iteration = 2 status = {"error":"rack not yet initialized: f35dae23-a43a-4d77-a204-fab3c4bdfff3"}
8402024-11-18T21:01:06.677ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8412024-11-18T21:01:06.677ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8422024-11-18T21:01:06.677ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8432024-11-18T21:01:06.677ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 444.621796ms
8442024-11-18T21:01:06.677ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 445.218031ms iteration = 1 status = {}
8452024-11-18T21:01:07.846ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8462024-11-18T21:01:07.847ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8472024-11-18T21:01:07.849ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8482024-11-18T21:01:07.849ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8492024-11-18T21:01:07.851ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8502024-11-18T21:01:07.853ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
8512024-11-18T21:01:07.854ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8522024-11-18T21:01:09.854ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8532024-11-18T21:01:09.854ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8542024-11-18T21:01:09.857ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8552024-11-18T21:01:09.857ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8562024-11-18T21:01:09.859ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8572024-11-18T21:01:09.861ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
8582024-11-18T21:01:09.861ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8592024-11-18T21:01:11.862ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8602024-11-18T21:01:11.862ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8612024-11-18T21:01:11.865ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8622024-11-18T21:01:11.865ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8632024-11-18T21:01:11.867ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642024-11-18T21:01:11.869ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
8652024-11-18T21:01:11.869ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8662024-11-18T21:01:13.871ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8672024-11-18T21:01:13.871ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8682024-11-18T21:01:13.873ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8692024-11-18T21:01:13.874ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8702024-11-18T21:01:13.875ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712024-11-18T21:01:13.878ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
8722024-11-18T21:01:13.878ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8732024-11-18T21:01:15.880ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8742024-11-18T21:01:15.880ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8752024-11-18T21:01:15.882ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8762024-11-18T21:01:15.883ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8772024-11-18T21:01:15.884ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782024-11-18T21:01:15.887ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
8792024-11-18T21:01:15.887ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8802024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
8812024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
8832024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8852024-11-18T21:01:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8862024-11-18T21:01:16.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872024-11-18T21:01:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8882024-11-18T21:01:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8892024-11-18T21:01:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8902024-11-18T21:01:16.240ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
8912024-11-18T21:01:16.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 8.277591ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
8922024-11-18T21:01:16.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8932024-11-18T21:01:16.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8942024-11-18T21:01:16.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.646235ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8952024-11-18T21:01:17.888ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8962024-11-18T21:01:17.888ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8972024-11-18T21:01:17.890ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8982024-11-18T21:01:17.890ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8992024-11-18T21:01:17.892ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9002024-11-18T21:01:17.894ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9012024-11-18T21:01:17.894ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9022024-11-18T21:01:19.896ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9032024-11-18T21:01:19.896ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9042024-11-18T21:01:19.897ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9052024-11-18T21:01:19.898ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9062024-11-18T21:01:19.899ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072024-11-18T21:01:19.902ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9082024-11-18T21:01:19.902ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9092024-11-18T21:01:21.904ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9102024-11-18T21:01:21.904ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9112024-11-18T21:01:21.906ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9122024-11-18T21:01:21.906ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9132024-11-18T21:01:21.907ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142024-11-18T21:01:21.910ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9152024-11-18T21:01:21.910ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9162024-11-18T21:01:23.911ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9172024-11-18T21:01:23.911ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9182024-11-18T21:01:23.913ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9192024-11-18T21:01:23.913ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9202024-11-18T21:01:23.914ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212024-11-18T21:01:23.917ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9222024-11-18T21:01:23.917ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9232024-11-18T21:01:25.918ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9242024-11-18T21:01:25.918ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9252024-11-18T21:01:25.920ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9262024-11-18T21:01:25.920ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9272024-11-18T21:01:25.922ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9282024-11-18T21:01:25.924ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9292024-11-18T21:01:25.924ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9302024-11-18T21:01:26.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
9312024-11-18T21:01:26.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322024-11-18T21:01:26.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
9332024-11-18T21:01:26.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342024-11-18T21:01:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9352024-11-18T21:01:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9362024-11-18T21:01:26.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9372024-11-18T21:01:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9382024-11-18T21:01:26.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9392024-11-18T21:01:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9402024-11-18T21:01:26.240ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9412024-11-18T21:01:26.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.784388ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9422024-11-18T21:01:26.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9432024-11-18T21:01:26.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9442024-11-18T21:01:26.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.107311ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9452024-11-18T21:01:27.925ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9462024-11-18T21:01:27.925ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9472024-11-18T21:01:27.927ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9482024-11-18T21:01:27.927ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9492024-11-18T21:01:27.928ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-11-18T21:01:27.931ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9512024-11-18T21:01:27.931ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9522024-11-18T21:01:29.932ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9532024-11-18T21:01:29.932ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9542024-11-18T21:01:29.934ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9552024-11-18T21:01:29.934ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9562024-11-18T21:01:29.935ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9572024-11-18T21:01:29.938ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9582024-11-18T21:01:29.938ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9592024-11-18T21:01:31.939ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9602024-11-18T21:01:31.939ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9612024-11-18T21:01:31.941ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9622024-11-18T21:01:31.941ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9632024-11-18T21:01:31.945ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642024-11-18T21:01:31.948ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9652024-11-18T21:01:31.948ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9662024-11-18T21:01:33.949ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9672024-11-18T21:01:33.950ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9682024-11-18T21:01:33.951ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9692024-11-18T21:01:33.951ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9702024-11-18T21:01:33.953ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712024-11-18T21:01:33.956ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9722024-11-18T21:01:33.956ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9732024-11-18T21:01:35.957ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9742024-11-18T21:01:35.957ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9752024-11-18T21:01:35.959ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9762024-11-18T21:01:35.959ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9772024-11-18T21:01:35.962ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782024-11-18T21:01:35.965ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
9792024-11-18T21:01:35.965ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9802024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
9812024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9822024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
9832024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9842024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9852024-11-18T21:01:36.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9862024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
9872024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
9882024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
9892024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9902024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9912024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9922024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
9932024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9942024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
9952024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9962024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
9972024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9982024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
9992024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
10002024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10012024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10022024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
10032024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
10042024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
10052024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10062024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10072024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10082024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
10092024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
10102024-11-18T21:01:36.232ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10112024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10122024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10132024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
10142024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10152024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
10162024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10172024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10182024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10192024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10202024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10212024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10222024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10232024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10242024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10252024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10262024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10272024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10282024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10292024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10302024-11-18T21:01:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10312024-11-18T21:01:36.234ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 556355144 } })
10322024-11-18T21:01:36.234ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
10332024-11-18T21:01:36.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 557034659 } })
10342024-11-18T21:01:36.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
10352024-11-18T21:01:36.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-11-18T21:01:36.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372024-11-18T21:01:36.236ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.01221ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10382024-11-18T21:01:36.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10392024-11-18T21:01:36.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10402024-11-18T21:01:36.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10412024-11-18T21:01:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10422024-11-18T21:01:36.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10432024-11-18T21:01:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10442024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10452024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10462024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10472024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10482024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10492024-11-18T21:01:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10502024-11-18T21:01:36.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512024-11-18T21:01:36.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522024-11-18T21:01:36.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.230661ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
10532024-11-18T21:01:36.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10542024-11-18T21:01:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10552024-11-18T21:01:36.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10562024-11-18T21:01:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10572024-11-18T21:01:36.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10582024-11-18T21:01:36.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10592024-11-18T21:01:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10602024-11-18T21:01:36.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.595256ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10612024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10622024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10632024-11-18T21:01:36.248ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10642024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10652024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10662024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10672024-11-18T21:01:36.248ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
10682024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.329312ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
10692024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10702024-11-18T21:01:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 16.822855ms iteration = 2 status = {}
10712024-11-18T21:01:36.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722024-11-18T21:01:36.255ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
10732024-11-18T21:01:36.255ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.81958ms iteration = 3 status = {"error":"rack not yet initialized: f35dae23-a43a-4d77-a204-fab3c4bdfff3"}
10742024-11-18T21:01:36.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10752024-11-18T21:01:36.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10762024-11-18T21:01:36.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10772024-11-18T21:01:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10782024-11-18T21:01:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10792024-11-18T21:01:36.260ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10802024-11-18T21:01:36.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.789445ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10812024-11-18T21:01:36.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10822024-11-18T21:01:36.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10832024-11-18T21:01:36.277ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10842024-11-18T21:01:36.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10852024-11-18T21:01:36.279ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10862024-11-18T21:01:36.279ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10872024-11-18T21:01:36.279ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10882024-11-18T21:01:36.279ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3c3ab3-5d7e-4630-8444-c2f64efc8369", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:35 GMT"} })
10892024-11-18T21:01:36.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10902024-11-18T21:01:36.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10912024-11-18T21:01:36.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.803836ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
10922024-11-18T21:01:36.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10932024-11-18T21:01:36.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10942024-11-18T21:01:36.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10952024-11-18T21:01:36.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10962024-11-18T21:01:36.284ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10972024-11-18T21:01:36.284ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95d977b6-300b-4e93-8944-1b392a97af7f", "content-length": "26", "date": "Mon, 18 Nov 2024 21:01:35 GMT"} })
10982024-11-18T21:01:36.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10992024-11-18T21:01:36.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11002024-11-18T21:01:36.295ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11012024-11-18T21:01:36.295ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11022024-11-18T21:01:36.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11032024-11-18T21:01:36.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11042024-11-18T21:01:36.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.390022ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11052024-11-18T21:01:36.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.850253ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11062024-11-18T21:01:36.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.071087ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11072024-11-18T21:01:36.325ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 93.014234ms iteration = 2 status = {}
11082024-11-18T21:01:36.339ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11092024-11-18T21:01:36.339ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "27523078-a3c9-483d-945b-44a9a7379929", "content-length": "1", "date": "Mon, 18 Nov 2024 21:01:36 GMT"} })
11102024-11-18T21:01:36.340ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11112024-11-18T21:01:36.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11122024-11-18T21:01:36.342ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 111.36026ms iteration = 2 status = null
11132024-11-18T21:01:36.344ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 113.268244ms iteration = 2 status = {}
11142024-11-18T21:01:36.345ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11152024-11-18T21:01:36.345ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11162024-11-18T21:01:36.345ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.354645ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11172024-11-18T21:01:36.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11182024-11-18T21:01:36.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11192024-11-18T21:01:36.413ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
11202024-11-18T21:01:36.413ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 181.825706ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
11212024-11-18T21:01:36.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11222024-11-18T21:01:36.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11232024-11-18T21:01:36.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-11-18T21:01:36.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11252024-11-18T21:01:36.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11262024-11-18T21:01:36.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11272024-11-18T21:01:36.458ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-11-18T21:01:36.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11292024-11-18T21:01:36.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11302024-11-18T21:01:36.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11312024-11-18T21:01:36.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 230.502759ms iteration = 2 status = {}
11322024-11-18T21:01:37.966ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11332024-11-18T21:01:37.967ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11342024-11-18T21:01:37.969ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11352024-11-18T21:01:37.969ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11362024-11-18T21:01:37.970ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-11-18T21:01:37.973ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11382024-11-18T21:01:37.973ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11392024-11-18T21:01:39.974ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11402024-11-18T21:01:39.974ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11412024-11-18T21:01:39.976ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11422024-11-18T21:01:39.976ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11432024-11-18T21:01:39.978ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442024-11-18T21:01:39.980ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11452024-11-18T21:01:39.980ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11462024-11-18T21:01:40.859ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:41801
11472024-11-18T21:01:40.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = f966aee4-186c-40f4-826a-85b5b0cfb610 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
11482024-11-18T21:01:40.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = f966aee4-186c-40f4-826a-85b5b0cfb610 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
11492024-11-18T21:01:40.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = f966aee4-186c-40f4-826a-85b5b0cfb610 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
11502024-11-18T21:01:40.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 1e628e35-d817-4385-984a-7e528c529f53 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
11512024-11-18T21:01:40.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 1e628e35-d817-4385-984a-7e528c529f53 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
11522024-11-18T21:01:40.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 1e628e35-d817-4385-984a-7e528c529f53 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
11532024-11-18T21:01:41.981ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11542024-11-18T21:01:41.982ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11552024-11-18T21:01:41.983ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11562024-11-18T21:01:41.984ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11572024-11-18T21:01:41.985ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11582024-11-18T21:01:41.988ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11592024-11-18T21:01:41.988ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11602024-11-18T21:01:43.989ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11612024-11-18T21:01:43.989ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11622024-11-18T21:01:43.992ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11632024-11-18T21:01:43.992ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11642024-11-18T21:01:43.994ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-11-18T21:01:43.997ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11662024-11-18T21:01:43.997ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11672024-11-18T21:01:45.997ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11682024-11-18T21:01:45.998ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11692024-11-18T21:01:46.000ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11702024-11-18T21:01:46.000ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11712024-11-18T21:01:46.001ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-11-18T21:01:46.004ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11732024-11-18T21:01:46.004ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11742024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
11752024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
11762024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11772024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11782024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11792024-11-18T21:01:46.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11802024-11-18T21:01:46.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-11-18T21:01:46.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11822024-11-18T21:01:46.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11832024-11-18T21:01:46.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11842024-11-18T21:01:46.239ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11852024-11-18T21:01:46.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.190094ms iteration = 5 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11862024-11-18T21:01:46.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11872024-11-18T21:01:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11882024-11-18T21:01:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.026281ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11892024-11-18T21:01:48.005ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11902024-11-18T21:01:48.006ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11912024-11-18T21:01:48.007ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11922024-11-18T21:01:48.007ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11932024-11-18T21:01:48.009ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-11-18T21:01:48.012ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
11952024-11-18T21:01:48.012ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11962024-11-18T21:01:50.012ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11972024-11-18T21:01:50.012ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11982024-11-18T21:01:50.014ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11992024-11-18T21:01:50.014ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12002024-11-18T21:01:50.016ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12012024-11-18T21:01:50.018ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
12022024-11-18T21:01:50.018ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12032024-11-18T21:01:52.019ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12042024-11-18T21:01:52.020ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12052024-11-18T21:01:52.021ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12062024-11-18T21:01:52.022ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12072024-11-18T21:01:52.023ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12082024-11-18T21:01:52.026ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
12092024-11-18T21:01:52.026ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12102024-11-18T21:01:54.027ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12112024-11-18T21:01:54.027ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12122024-11-18T21:01:54.029ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12132024-11-18T21:01:54.029ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12142024-11-18T21:01:54.031ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152024-11-18T21:01:54.033ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
12162024-11-18T21:01:54.033ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12172024-11-18T21:01:56.034ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12182024-11-18T21:01:56.035ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12192024-11-18T21:01:56.037ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12202024-11-18T21:01:56.037ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12212024-11-18T21:01:56.039ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222024-11-18T21:01:56.041ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
12232024-11-18T21:01:56.041ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12242024-11-18T21:01:56.069ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56247
12252024-11-18T21:01:56.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = a8b66afd-98a5-4457-990b-efac52531ed3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12262024-11-18T21:01:56.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = a8b66afd-98a5-4457-990b-efac52531ed3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12272024-11-18T21:01:56.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = a8b66afd-98a5-4457-990b-efac52531ed3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12282024-11-18T21:01:56.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = f96fc515-c5cf-44a7-bb20-7b935bb393e9 roles = RoleSet { roles: {} } uri = /sled-agents/79cbda5a-2e27-489e-945d-860d86dec819
12292024-11-18T21:01:56.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = f96fc515-c5cf-44a7-bb20-7b935bb393e9 resource = Database result = Ok(()) uri = /sled-agents/79cbda5a-2e27-489e-945d-860d86dec819
12302024-11-18T21:01:56.085ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "79cbda5a-2e27-489e-945d-860d86dec819" error_message_internal = not found: sled with id "79cbda5a-2e27-489e-945d-860d86dec819" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 3529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = f96fc515-c5cf-44a7-bb20-7b935bb393e9 response_code = 404 uri = /sled-agents/79cbda5a-2e27-489e-945d-860d86dec819
12312024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
12322024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
12332024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12342024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12352024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12362024-11-18T21:01:56.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12372024-11-18T21:01:56.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12382024-11-18T21:01:56.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12392024-11-18T21:01:56.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-11-18T21:01:56.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.141674ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12412024-11-18T21:01:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12422024-11-18T21:01:56.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12432024-11-18T21:01:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442024-11-18T21:01:56.239ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
12452024-11-18T21:01:56.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.513138ms iteration = 6 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
12462024-11-18T21:01:56.438ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:38868
12472024-11-18T21:01:57.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ba0aad99-3458-411e-8d29-9417069b5dff roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12482024-11-18T21:01:57.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ba0aad99-3458-411e-8d29-9417069b5dff resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12492024-11-18T21:01:57.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ba0aad99-3458-411e-8d29-9417069b5dff response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
12502024-11-18T21:01:57.213ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = 79cbda5a-2e27-489e-945d-860d86dec819
12512024-11-18T21:01:57.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21916 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1530f856-9298-406d-8154-2eb4e70748b0 response_code = 204 uri = /sled-agents/79cbda5a-2e27-489e-945d-860d86dec819
12522024-11-18T21:01:57.231ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12532024-11-18T21:01:57.231ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12542024-11-18T21:01:57.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12552024-11-18T21:01:57.233ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12562024-11-18T21:01:57.235ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12572024-11-18T21:01:57.235ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12582024-11-18T21:01:57.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12592024-11-18T21:01:57.247ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(df8f78cd-5531-431c-9652-c966cfe78b20, 0), (246f9f93-3955-4b01-b489-f0f023634ac0, 0), (446e44f2-6d00-4404-b1cf-f0710c40cc2b, 0)]
12602024-11-18T21:01:57.247ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1026, tv_nsec: 569755662 } })
12612024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
12622024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
12632024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
12642024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "84de326c-8956-47f7-bfc7-d7c25960dffb", "content-length": "476", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12652024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
12662024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e9a9731-8e01-482a-99ee-033e2d1485be", "content-length": "734", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12672024-11-18T21:01:57.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
12682024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b17cd596-7957-4ca6-b88e-b3d48cc518fc", "content-length": "111", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12692024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
12702024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a39171cb-1850-4a97-bdc8-80c5a24d4984", "content-length": "111", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12712024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
12722024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d020baf-eb98-4e14-a21e-92e46287ad40", "content-length": "167", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12732024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
12742024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fa52afb-680e-4ded-91c1-982c3c594ec4", "content-length": "167", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12752024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
12762024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e661b5d2-2aab-4463-a18c-b11dd3019800", "content-length": "175", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12772024-11-18T21:01:57.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
12782024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "96e23be6-606b-4ef0-9e37-b78bfde213f7", "content-length": "175", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12792024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
12802024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e309cd36-c126-41dd-8d3f-569afea6e013", "content-length": "702", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12812024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12822024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "60418201-0d01-41ab-8bb7-2c833dcb477c", "content-length": "727", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12832024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12842024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "089d0d3e-1d82-41a1-b298-68b7ac96a3ac", "content-length": "729", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12852024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12862024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "521009b1-f5ad-448e-bd85-0392d628537c", "content-length": "728", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12872024-11-18T21:01:57.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
12882024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "469c72ae-ee26-4d4d-857a-983f21ff2b31", "content-length": "722", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12892024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
12902024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd21ffe2-2c9b-4293-a29c-d5e35a92ecf0", "content-length": "109", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12912024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
12922024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed54fb93-d6e8-4890-8560-4e1e9744ce5d", "content-length": "109", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12932024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
12942024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "64ce2c14-2e59-40c1-bff2-887ea3ebb346", "content-length": "169", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12952024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
12962024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d15dbe3-4a60-4d47-b960-f7652f481273", "content-length": "169", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12972024-11-18T21:01:57.282ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
12982024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dbc271a-9273-4bf4-9c07-ef40fb93a080", "content-length": "178", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
12992024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
13002024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c628be-43f9-4a94-85d7-49e4e7d5b7cb", "content-length": "178", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13012024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
13022024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "becd934c-2e7a-420f-8af5-23a59a83d052", "content-length": "702", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13032024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13042024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cac0d910-0de1-44c1-9baa-395d98007476", "content-length": "727", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13052024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13062024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e13306-8940-4411-9104-c49a9f796ca1", "content-length": "729", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13072024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13082024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "899185bb-3c81-4390-af6b-31af35a4adcf", "content-length": "728", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13092024-11-18T21:01:57.283ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13102024-11-18T21:01:57.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13112024-11-18T21:01:57.285ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-11-18T21:01:57.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
13132024-11-18T21:01:57.287ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13142024-11-18T21:01:57.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13152024-11-18T21:01:57.289ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-11-18T21:01:57.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
13172024-11-18T21:01:57.291ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13182024-11-18T21:01:57.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13192024-11-18T21:01:57.325ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
13202024-11-18T21:01:57.325ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
13212024-11-18T21:01:57.526ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8dda2d7-fd13-4db9-9bf0-939a9cce47ae", "content-length": "30741", "date": "Mon, 18 Nov 2024 21:01:57 GMT"} })
13222024-11-18T21:01:57.527ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
13232024-11-18T21:01:57.527ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
13242024-11-18T21:01:57.527ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
13252024-11-18T21:01:57.528ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13262024-11-18T21:01:57.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13272024-11-18T21:01:57.531ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13282024-11-18T21:01:57.532ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13292024-11-18T21:01:57.533ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13302024-11-18T21:01:57.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13312024-11-18T21:01:57.800ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 7c6a5541-3950-4199-821b-53725769ca5b file = nexus/db-queries/src/db/datastore/inventory.rs:1000
13322024-11-18T21:01:57.800ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 7c6a5541-3950-4199-821b-53725769ca5b time_started = 2024-11-18 21:01:57.278985 UTC
13332024-11-18T21:01:57.800ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 569.472796ms iteration = 2 status = {"collection_id":"7c6a5541-3950-4199-821b-53725769ca5b","time_done":"2024-11-18 21:01:57.527512 UTC","time_started":"2024-11-18 21:01:57.278985 UTC"}
13342024-11-18T21:01:57.800ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
13352024-11-18T21:01:57.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13362024-11-18T21:01:57.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13372024-11-18T21:01:57.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13382024-11-18T21:01:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13392024-11-18T21:01:57.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13402024-11-18T21:01:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13412024-11-18T21:01:57.806ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
13422024-11-18T21:01:57.806ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.708422ms iteration = 4 status = {"error":"rack not yet initialized: f35dae23-a43a-4d77-a204-fab3c4bdfff3"}
13432024-11-18T21:01:58.042ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13442024-11-18T21:01:58.043ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13452024-11-18T21:01:58.044ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13462024-11-18T21:01:58.044ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13472024-11-18T21:01:58.046ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482024-11-18T21:01:58.049ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
13492024-11-18T21:01:58.049ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13502024-11-18T21:01:58.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2df6b5b-6035-4e83-9af8-0b4c2385f64a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13512024-11-18T21:01:58.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2df6b5b-6035-4e83-9af8-0b4c2385f64a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13522024-11-18T21:01:58.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2df6b5b-6035-4e83-9af8-0b4c2385f64a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13532024-11-18T21:01:59.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8072568a-f014-431b-bfd6-ce46821a2fe4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13542024-11-18T21:01:59.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8072568a-f014-431b-bfd6-ce46821a2fe4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13552024-11-18T21:01:59.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8072568a-f014-431b-bfd6-ce46821a2fe4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13562024-11-18T21:02:00.050ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13572024-11-18T21:02:00.051ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13582024-11-18T21:02:00.052ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13592024-11-18T21:02:00.052ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13602024-11-18T21:02:00.054ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612024-11-18T21:02:00.057ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
13622024-11-18T21:02:00.057ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13632024-11-18T21:02:00.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47907704-eaae-45f5-9e23-dc71cbe18ff7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13642024-11-18T21:02:00.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47907704-eaae-45f5-9e23-dc71cbe18ff7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13652024-11-18T21:02:00.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47907704-eaae-45f5-9e23-dc71cbe18ff7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13662024-11-18T21:02:01.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e2914c2-5ade-4628-bc80-df33c8b87966 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13672024-11-18T21:02:01.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e2914c2-5ade-4628-bc80-df33c8b87966 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13682024-11-18T21:02:01.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e2914c2-5ade-4628-bc80-df33c8b87966 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13692024-11-18T21:02:02.058ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13702024-11-18T21:02:02.059ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13712024-11-18T21:02:02.060ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13722024-11-18T21:02:02.061ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13732024-11-18T21:02:02.062ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742024-11-18T21:02:02.065ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
13752024-11-18T21:02:02.065ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13762024-11-18T21:02:02.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01a3cc78-ec72-49ae-abc5-18b666c519b7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13772024-11-18T21:02:02.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01a3cc78-ec72-49ae-abc5-18b666c519b7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13782024-11-18T21:02:02.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01a3cc78-ec72-49ae-abc5-18b666c519b7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13792024-11-18T21:02:03.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb650cf7-b8e2-45c6-99f5-87aa03cdfed0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13802024-11-18T21:02:03.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb650cf7-b8e2-45c6-99f5-87aa03cdfed0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13812024-11-18T21:02:03.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb650cf7-b8e2-45c6-99f5-87aa03cdfed0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13822024-11-18T21:02:04.066ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13832024-11-18T21:02:04.067ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13842024-11-18T21:02:04.068ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13852024-11-18T21:02:04.069ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13862024-11-18T21:02:04.070ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-11-18T21:02:04.073ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
13882024-11-18T21:02:04.073ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13892024-11-18T21:02:04.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa37928f-b1c6-4b69-a2da-5835ad88c7db roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13902024-11-18T21:02:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa37928f-b1c6-4b69-a2da-5835ad88c7db resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13912024-11-18T21:02:04.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa37928f-b1c6-4b69-a2da-5835ad88c7db response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13922024-11-18T21:02:05.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ed6485b-a86c-4109-879c-1eb98fcd135d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13932024-11-18T21:02:05.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ed6485b-a86c-4109-879c-1eb98fcd135d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13942024-11-18T21:02:05.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ed6485b-a86c-4109-879c-1eb98fcd135d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
13952024-11-18T21:02:06.074ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13962024-11-18T21:02:06.075ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13972024-11-18T21:02:06.084ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13982024-11-18T21:02:06.084ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13992024-11-18T21:02:06.087ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-11-18T21:02:06.090ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
14012024-11-18T21:02:06.090ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
14022024-11-18T21:02:06.231ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
14032024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
14042024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14052024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
14062024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14072024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14082024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14092024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
14102024-11-18T21:02:06.232ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
14112024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 9.06\u{b5}s iteration = 3 status = {"error":"no config"}
14122024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
14132024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
14142024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14152024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
14162024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14172024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
14182024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14192024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
14202024-11-18T21:02:06.232ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:52:06.232065462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14212024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14222024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
14232024-11-18T21:02:06.232ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
14242024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 8.831\u{b5}s iteration = 3 status = {"error":"no config"}
14252024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
14262024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14272024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
14282024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Timeout
14292024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
14302024-11-18T21:02:06.232ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
14312024-11-18T21:02:06.232ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14322024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14332024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.4\u{b5}s iteration = 2 status = {"error":"no blueprint"}
14342024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14352024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
14362024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
14372024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
14382024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14392024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14402024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
14412024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
14422024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14432024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14442024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14452024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
14462024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
14472024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14482024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
14492024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14512024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
14522024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14532024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
14542024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
14552024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14562024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14572024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
14582024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14592024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
14602024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14612024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
14622024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14632024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
14642024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
14652024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14662024-11-18T21:02:06.232ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14672024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14682024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14692024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14702024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14712024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14722024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14732024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14742024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14752024-11-18T21:02:06.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 554513971 } })
14762024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14772024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14782024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14792024-11-18T21:02:06.232ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 554624941 } })
14802024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14812024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14822024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14832024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14842024-11-18T21:02:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14852024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14862024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14872024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14882024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14892024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14902024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14912024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14922024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14932024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14942024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14952024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.23966ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14962024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
14972024-11-18T21:02:06.233ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.31085ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
14982024-11-18T21:02:06.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14992024-11-18T21:02:06.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15002024-11-18T21:02:06.234ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.561629ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15012024-11-18T21:02:06.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 557709284 } })
15022024-11-18T21:02:06.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
15032024-11-18T21:02:06.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15042024-11-18T21:02:06.236ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15052024-11-18T21:02:06.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15062024-11-18T21:02:06.236ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:52:06.232065462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15072024-11-18T21:02:06.236ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.620205ms iteration = 2 status = {"expiration":"2024-11-18T20:52:06.232065462Z","pruned":[]}
15082024-11-18T21:02:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15092024-11-18T21:02:06.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15102024-11-18T21:02:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15112024-11-18T21:02:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122024-11-18T21:02:06.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132024-11-18T21:02:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15142024-11-18T21:02:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15152024-11-18T21:02:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15162024-11-18T21:02:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15172024-11-18T21:02:06.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15182024-11-18T21:02:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15192024-11-18T21:02:06.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-11-18T21:02:06.248ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.645514ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
15212024-11-18T21:02:06.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 570989814 } })
15222024-11-18T21:02:06.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
15232024-11-18T21:02:06.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15242024-11-18T21:02:06.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15252024-11-18T21:02:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15262024-11-18T21:02:06.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15272024-11-18T21:02:06.258ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
15282024-11-18T21:02:06.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.410537ms iteration = 7 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
15292024-11-18T21:02:06.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15302024-11-18T21:02:06.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-11-18T21:02:06.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15322024-11-18T21:02:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15332024-11-18T21:02:06.269ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
15342024-11-18T21:02:06.269ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 37.63947ms iteration = 5 status = {"error":"rack not yet initialized: f35dae23-a43a-4d77-a204-fab3c4bdfff3"}
15352024-11-18T21:02:06.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15362024-11-18T21:02:06.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15372024-11-18T21:02:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15382024-11-18T21:02:06.278ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15392024-11-18T21:02:06.278ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15402024-11-18T21:02:06.278ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.201215ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15412024-11-18T21:02:06.282ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15422024-11-18T21:02:06.282ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15432024-11-18T21:02:06.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15442024-11-18T21:02:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15452024-11-18T21:02:06.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-11-18T21:02:06.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15472024-11-18T21:02:06.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15482024-11-18T21:02:06.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-11-18T21:02:06.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.170269ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
15502024-11-18T21:02:06.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15512024-11-18T21:02:06.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15522024-11-18T21:02:06.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15532024-11-18T21:02:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15542024-11-18T21:02:06.286ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15552024-11-18T21:02:06.286ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15562024-11-18T21:02:06.286ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15572024-11-18T21:02:06.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15582024-11-18T21:02:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15592024-11-18T21:02:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15602024-11-18T21:02:06.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15612024-11-18T21:02:06.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15622024-11-18T21:02:06.287ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15632024-11-18T21:02:06.287ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15642024-11-18T21:02:06.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15652024-11-18T21:02:06.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15662024-11-18T21:02:06.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15672024-11-18T21:02:06.288ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1c3bc97-9948-4cbb-ade6-766da68dfcac", "content-length": "26", "date": "Mon, 18 Nov 2024 21:02:06 GMT"} })
15682024-11-18T21:02:06.288ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15692024-11-18T21:02:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15702024-11-18T21:02:06.289ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15712024-11-18T21:02:06.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15742024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15752024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15762024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15772024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 65.090855ms iteration = 3 status = {}
15782024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15792024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15802024-11-18T21:02:06.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15812024-11-18T21:02:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15822024-11-18T21:02:06.299ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15832024-11-18T21:02:06.299ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15842024-11-18T21:02:06.299ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.98581ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15852024-11-18T21:02:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15862024-11-18T21:02:06.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15872024-11-18T21:02:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15882024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15892024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15902024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.046625ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
15912024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15922024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15932024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15942024-11-18T21:02:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15952024-11-18T21:02:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15962024-11-18T21:02:06.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-11-18T21:02:06.303ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
15982024-11-18T21:02:06.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 71.696245ms iteration = 2 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
15992024-11-18T21:02:06.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16002024-11-18T21:02:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16012024-11-18T21:02:06.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16022024-11-18T21:02:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16032024-11-18T21:02:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16042024-11-18T21:02:06.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16052024-11-18T21:02:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16062024-11-18T21:02:06.309ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16072024-11-18T21:02:06.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.607992ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16082024-11-18T21:02:06.313ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
16092024-11-18T21:02:06.313ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 81.226086ms iteration = 2 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
16102024-11-18T21:02:06.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a15f5f5-502a-472d-9330-3dec2bc90f8d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16112024-11-18T21:02:06.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a15f5f5-502a-472d-9330-3dec2bc90f8d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16122024-11-18T21:02:06.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16132024-11-18T21:02:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16142024-11-18T21:02:06.330ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16152024-11-18T21:02:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16162024-11-18T21:02:06.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16172024-11-18T21:02:06.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16182024-11-18T21:02:06.335ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bafd7e7d-00a5-4a09-8409-dda61803fb03", "content-length": "26", "date": "Mon, 18 Nov 2024 21:02:06 GMT"} })
16192024-11-18T21:02:06.335ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16202024-11-18T21:02:06.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16212024-11-18T21:02:06.336ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16222024-11-18T21:02:06.336ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16232024-11-18T21:02:06.336ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16242024-11-18T21:02:06.336ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.399659ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16252024-11-18T21:02:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16262024-11-18T21:02:06.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.62627ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16272024-11-18T21:02:06.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.538755ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16282024-11-18T21:02:06.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.102044ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16292024-11-18T21:02:06.373ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 141.149803ms iteration = 3 status = {}
16302024-11-18T21:02:06.397ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16312024-11-18T21:02:06.398ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c97e9e-3769-4ad5-a23c-04d898b167fa", "content-length": "691", "date": "Mon, 18 Nov 2024 21:02:05 GMT"} })
16322024-11-18T21:02:06.398ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16332024-11-18T21:02:06.398ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16342024-11-18T21:02:06.398ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16352024-11-18T21:02:06.399ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 167.233437ms iteration = 3 status = {}
16362024-11-18T21:02:06.407ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
16372024-11-18T21:02:06.407ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.052465ms iteration = 2 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
16382024-11-18T21:02:06.420ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16392024-11-18T21:02:06.420ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05e238ae-2e7a-4dea-b3ef-ce70aca7667f", "content-length": "1", "date": "Mon, 18 Nov 2024 21:02:05 GMT"} })
16402024-11-18T21:02:06.421ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16412024-11-18T21:02:06.421ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16422024-11-18T21:02:06.421ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5aed780-f0dc-4c4a-a76f-e6eefebb0dd1", "content-length": "372", "date": "Mon, 18 Nov 2024 21:02:05 GMT"} })
16432024-11-18T21:02:06.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16442024-11-18T21:02:06.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16452024-11-18T21:02:06.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16462024-11-18T21:02:06.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16472024-11-18T21:02:06.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a15f5f5-502a-472d-9330-3dec2bc90f8d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16482024-11-18T21:02:06.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16492024-11-18T21:02:06.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16502024-11-18T21:02:06.428ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 196.001822ms iteration = 3 status = null
16512024-11-18T21:02:06.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.057671ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16522024-11-18T21:02:06.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16532024-11-18T21:02:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
16542024-11-18T21:02:06.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16552024-11-18T21:02:06.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16562024-11-18T21:02:06.465ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 232.944057ms iteration = 3 status = 0
16572024-11-18T21:02:06.479ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16582024-11-18T21:02:06.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16592024-11-18T21:02:06.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc7afdb5-ca45-4047-bd69-955ce063e5aa", "date": "Mon, 18 Nov 2024 21:02:05 GMT"} })
16602024-11-18T21:02:06.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16612024-11-18T21:02:06.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16622024-11-18T21:02:06.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16632024-11-18T21:02:06.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16642024-11-18T21:02:06.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16652024-11-18T21:02:06.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16662024-11-18T21:02:06.489ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16672024-11-18T21:02:06.489ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16682024-11-18T21:02:06.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1c0b295-11d5-444f-ba7a-6a4ae44e6921", "date": "Mon, 18 Nov 2024 21:02:05 GMT"} })
16692024-11-18T21:02:06.491ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.984142ms iteration = 3 status = {}
16702024-11-18T21:02:06.514ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16712024-11-18T21:02:06.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 281.683921ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16722024-11-18T21:02:07.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4cec2529-3058-4fd9-82f0-4557201deb55 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16732024-11-18T21:02:07.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4cec2529-3058-4fd9-82f0-4557201deb55 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16742024-11-18T21:02:07.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4cec2529-3058-4fd9-82f0-4557201deb55 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16752024-11-18T21:02:08.090ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16762024-11-18T21:02:08.091ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16772024-11-18T21:02:08.092ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16782024-11-18T21:02:08.092ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16792024-11-18T21:02:08.094ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16802024-11-18T21:02:08.097ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
16812024-11-18T21:02:08.097ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16822024-11-18T21:02:08.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7139c901-ba4b-4cf2-a49c-c9613f0a70bb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16832024-11-18T21:02:08.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7139c901-ba4b-4cf2-a49c-c9613f0a70bb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16842024-11-18T21:02:08.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7139c901-ba4b-4cf2-a49c-c9613f0a70bb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16852024-11-18T21:02:09.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fd2b7f6-f1c3-4fc9-b995-92e8bc78ed00 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16862024-11-18T21:02:09.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fd2b7f6-f1c3-4fc9-b995-92e8bc78ed00 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16872024-11-18T21:02:09.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fd2b7f6-f1c3-4fc9-b995-92e8bc78ed00 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16882024-11-18T21:02:10.099ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16892024-11-18T21:02:10.099ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16902024-11-18T21:02:10.101ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16912024-11-18T21:02:10.101ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16922024-11-18T21:02:10.129ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16932024-11-18T21:02:10.132ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
16942024-11-18T21:02:10.132ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16952024-11-18T21:02:10.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cc92b0e5-862d-42f7-bb29-831278ccbb66 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16962024-11-18T21:02:10.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cc92b0e5-862d-42f7-bb29-831278ccbb66 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16972024-11-18T21:02:10.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cc92b0e5-862d-42f7-bb29-831278ccbb66 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
16982024-11-18T21:02:10.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 61b35ec7-6817-424f-b5d8-b568826053aa roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
16992024-11-18T21:02:10.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 61b35ec7-6817-424f-b5d8-b568826053aa resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
17002024-11-18T21:02:10.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 61b35ec7-6817-424f-b5d8-b568826053aa response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
17012024-11-18T21:02:10.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = fe297f29-9492-4572-b5c4-7ca102d44298 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
17022024-11-18T21:02:10.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = fe297f29-9492-4572-b5c4-7ca102d44298 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
17032024-11-18T21:02:10.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = fe297f29-9492-4572-b5c4-7ca102d44298 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
17042024-11-18T21:02:11.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c33d5f6-7d46-4886-a373-82a593e6d4fe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17052024-11-18T21:02:11.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c33d5f6-7d46-4886-a373-82a593e6d4fe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17062024-11-18T21:02:11.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c33d5f6-7d46-4886-a373-82a593e6d4fe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17072024-11-18T21:02:12.133ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17082024-11-18T21:02:12.133ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17092024-11-18T21:02:12.135ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17102024-11-18T21:02:12.135ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17112024-11-18T21:02:12.137ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17122024-11-18T21:02:12.139ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
17132024-11-18T21:02:12.139ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, time_created: 2024-11-18T21:01:05.990220Z, time_modified: 2024-11-18T21:01:05.990220Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
17142024-11-18T21:02:12.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff7d18b3-638b-49d7-bad4-d2c52cb807f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17152024-11-18T21:02:12.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff7d18b3-638b-49d7-bad4-d2c52cb807f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17162024-11-18T21:02:12.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff7d18b3-638b-49d7-bad4-d2c52cb807f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17172024-11-18T21:02:13.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84e95d05-7c99-423b-a049-f19e80300de4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17182024-11-18T21:02:13.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84e95d05-7c99-423b-a049-f19e80300de4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17192024-11-18T21:02:13.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84e95d05-7c99-423b-a049-f19e80300de4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
17202024-11-18T21:02:14.140ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17212024-11-18T21:02:14.140ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17222024-11-18T21:02:14.142ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17232024-11-18T21:02:14.142ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17242024-11-18T21:02:14.144ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-11-18T21:02:14.147ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f35dae23-a43a-4d77-a204-fab3c4bdfff3, lookup_type: ById(f35dae23-a43a-4d77-a204-fab3c4bdfff3) } result = Ok(())
17262024-11-18T21:02:14.147ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
17272024-11-18T21:02:14.147ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17282024-11-18T21:02:14.147ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17292024-11-18T21:02:14.149ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17302024-11-18T21:02:14.149ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17312024-11-18T21:02:14.154ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17322024-11-18T21:02:14.154ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17332024-11-18T21:02:14.156ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17342024-11-18T21:02:14.156ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17352024-11-18T21:02:14.158ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17362024-11-18T21:02:14.158ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17372024-11-18T21:02:14.159ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17382024-11-18T21:02:14.159ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17392024-11-18T21:02:14.160ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-11-18T21:02:14.163ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17412024-11-18T21:02:14.163ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17422024-11-18T21:02:14.163ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17432024-11-18T21:02:14.191ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17442024-11-18T21:02:14.191ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17452024-11-18T21:02:14.220ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17462024-11-18T21:02:14.221ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17472024-11-18T21:02:14.222ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17482024-11-18T21:02:14.225ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17492024-11-18T21:02:14.225ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17502024-11-18T21:02:14.225ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17512024-11-18T21:02:14.227ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17522024-11-18T21:02:14.228ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17532024-11-18T21:02:14.229ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17542024-11-18T21:02:14.229ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17552024-11-18T21:02:14.230ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17562024-11-18T21:02:14.231ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17572024-11-18T21:02:14.232ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17582024-11-18T21:02:14.232ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17592024-11-18T21:02:14.233ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17602024-11-18T21:02:14.233ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17612024-11-18T21:02:14.235ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17622024-11-18T21:02:14.235ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17632024-11-18T21:02:14.236ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-11-18T21:02:14.239ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17652024-11-18T21:02:14.239ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17662024-11-18T21:02:14.239ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17672024-11-18T21:02:14.240ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17682024-11-18T21:02:14.240ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17692024-11-18T21:02:14.242ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17702024-11-18T21:02:14.242ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17712024-11-18T21:02:14.244ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17722024-11-18T21:02:14.244ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17732024-11-18T21:02:14.246ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17742024-11-18T21:02:14.246ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17752024-11-18T21:02:14.246ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17762024-11-18T21:02:14.247ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17772024-11-18T21:02:14.248ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17782024-11-18T21:02:14.248ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17792024-11-18T21:02:14.249ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17802024-11-18T21:02:14.252ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17812024-11-18T21:02:14.252ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17822024-11-18T21:02:14.252ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17832024-11-18T21:02:14.254ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17842024-11-18T21:02:14.254ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17852024-11-18T21:02:14.255ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17862024-11-18T21:02:14.255ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17872024-11-18T21:02:14.256ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-11-18T21:02:14.259ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
17892024-11-18T21:02:14.259ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17902024-11-18T21:02:14.260ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17912024-11-18T21:02:14.263ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17922024-11-18T21:02:14.264ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17932024-11-18T21:02:14.265ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17942024-11-18T21:02:14.265ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17952024-11-18T21:02:14.267ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17962024-11-18T21:02:14.267ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17972024-11-18T21:02:14.268ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17982024-11-18T21:02:14.268ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17992024-11-18T21:02:14.271ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18002024-11-18T21:02:14.271ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18012024-11-18T21:02:14.272ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18022024-11-18T21:02:14.272ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18032024-11-18T21:02:14.274ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18042024-11-18T21:02:14.274ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18052024-11-18T21:02:14.275ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062024-11-18T21:02:14.278ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18072024-11-18T21:02:14.278ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18082024-11-18T21:02:14.278ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18092024-11-18T21:02:14.279ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18102024-11-18T21:02:14.280ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18112024-11-18T21:02:14.281ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18122024-11-18T21:02:14.281ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18132024-11-18T21:02:14.282ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18142024-11-18T21:02:14.285ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18152024-11-18T21:02:14.285ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18162024-11-18T21:02:14.285ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18172024-11-18T21:02:14.292ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
18182024-11-18T21:02:14.292ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18192024-11-18T21:02:14.292ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18202024-11-18T21:02:14.293ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18212024-11-18T21:02:14.295ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
18222024-11-18T21:02:14.295ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18232024-11-18T21:02:14.295ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18242024-11-18T21:02:14.296ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
18252024-11-18T21:02:14.300ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
18262024-11-18T21:02:14.300ZDEBGnexus (InternalApi): resolved 2 rules for sleds
18272024-11-18T21:02:14.427ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 79cbda5a-2e27-489e-945d-860d86dec819, time_created: 2024-11-18T21:01:57.213298Z, time_modified: 2024-11-18T21:01:57.213298Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
18282024-11-18T21:02:14.427ZDEBGnexus (InternalApi): sending firewall rules to sled agents
18292024-11-18T21:02:14.427ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18302024-11-18T21:02:14.427ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18312024-11-18T21:02:14.430ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18322024-11-18T21:02:14.430ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18332024-11-18T21:02:14.431ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342024-11-18T21:02:14.434ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
18352024-11-18T21:02:14.466ZDEBGnexus (InternalApi): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18362024-11-18T21:02:14.467ZDEBGnexus (InternalApi): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "adc1d8d4-4115-4226-b5ea-a93739d682bf", "date": "Mon, 18 Nov 2024 21:02:14 GMT"} })
18372024-11-18T21:02:14.467ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
18382024-11-18T21:02:14.467ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
18392024-11-18T21:02:14.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c74a404-bf0f-4df5-a9b9-1eee4bc58fed roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18402024-11-18T21:02:14.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c74a404-bf0f-4df5-a9b9-1eee4bc58fed resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18412024-11-18T21:02:14.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c74a404-bf0f-4df5-a9b9-1eee4bc58fed response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18422024-11-18T21:02:15.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7b084cd3-cef6-48b7-8f41-3d5ec4e2f849 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18432024-11-18T21:02:15.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7b084cd3-cef6-48b7-8f41-3d5ec4e2f849 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18442024-11-18T21:02:15.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7b084cd3-cef6-48b7-8f41-3d5ec4e2f849 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
18452024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
18462024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18472024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
18482024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18492024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18502024-11-18T21:02:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512024-11-18T21:02:16.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18522024-11-18T21:02:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18532024-11-18T21:02:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18542024-11-18T21:02:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18552024-11-18T21:02:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18562024-11-18T21:02:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572024-11-18T21:02:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582024-11-18T21:02:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
18592024-11-18T21:02:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18602024-11-18T21:02:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18612024-11-18T21:02:16.263ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
18622024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.918211ms iteration = 8 status = {"enabled":false,"status":"first target blueprint","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z","time_found":"2024-11-18T21:02:16.263441365Z"}
18632024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
18642024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Dependency
18652024-11-18T21:02:16.263ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
18662024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.58\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
18672024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18682024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18692024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18702024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18712024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18722024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18732024-11-18T21:02:16.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18742024-11-18T21:02:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18752024-11-18T21:02:16.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18762024-11-18T21:02:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18772024-11-18T21:02:16.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18782024-11-18T21:02:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18792024-11-18T21:02:16.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-11-18T21:02:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18812024-11-18T21:02:16.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18822024-11-18T21:02:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18832024-11-18T21:02:16.269ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18842024-11-18T21:02:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18852024-11-18T21:02:16.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18862024-11-18T21:02:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18872024-11-18T21:02:16.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882024-11-18T21:02:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18892024-11-18T21:02:16.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18902024-11-18T21:02:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18912024-11-18T21:02:16.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18922024-11-18T21:02:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18932024-11-18T21:02:16.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18942024-11-18T21:02:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18952024-11-18T21:02:16.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-11-18T21:02:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18972024-11-18T21:02:16.277ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18982024-11-18T21:02:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18992024-11-18T21:02:16.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.231624ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19002024-11-18T21:02:16.316ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
19012024-11-18T21:02:16.351ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
19022024-11-18T21:02:16.383ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
19032024-11-18T21:02:16.416ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
19042024-11-18T21:02:16.450ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
19052024-11-18T21:02:16.450ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fd81e4e-7700-4036-b49c-354c0b576b2f", "content-length": "64", "date": "Mon, 18 Nov 2024 21:02:15 GMT"} })
19062024-11-18T21:02:16.450ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19072024-11-18T21:02:16.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19082024-11-18T21:02:16.451ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "39250787-45c4-41ed-8cb6-5c8c8a4c137c", "content-length": "64", "date": "Mon, 18 Nov 2024 21:02:15 GMT"} })
19092024-11-18T21:02:16.451ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19102024-11-18T21:02:16.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19112024-11-18T21:02:16.452ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19122024-11-18T21:02:16.453ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19132024-11-18T21:02:16.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19142024-11-18T21:02:16.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19152024-11-18T21:02:16.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19162024-11-18T21:02:16.454ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19172024-11-18T21:02:16.454ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19182024-11-18T21:02:16.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19192024-11-18T21:02:16.496ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87f94a50-d346-40b0-8d46-1aa8965ab36f", "content-length": "64", "date": "Mon, 18 Nov 2024 21:02:15 GMT"} })
19202024-11-18T21:02:16.496ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19212024-11-18T21:02:16.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19222024-11-18T21:02:16.497ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232024-11-18T21:02:16.499ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19242024-11-18T21:02:16.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19252024-11-18T21:02:16.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19262024-11-18T21:02:16.501ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc0f9287-b642-4251-8a26-27b8d7fa3cfd", "content-length": "64", "date": "Mon, 18 Nov 2024 21:02:15 GMT"} })
19272024-11-18T21:02:16.501ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19282024-11-18T21:02:16.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19292024-11-18T21:02:16.504ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302024-11-18T21:02:16.506ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19312024-11-18T21:02:16.506ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19322024-11-18T21:02:16.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19332024-11-18T21:02:16.549ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c313c688-4ad9-4e6b-8d16-3a93c2017b2d", "content-length": "64", "date": "Mon, 18 Nov 2024 21:02:16 GMT"} })
19342024-11-18T21:02:16.549ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19352024-11-18T21:02:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19362024-11-18T21:02:16.551ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-11-18T21:02:16.552ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19382024-11-18T21:02:16.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19392024-11-18T21:02:16.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19402024-11-18T21:02:16.560ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 296.865134ms iteration = 2 status = {"nsuccess":5}
19412024-11-18T21:02:16.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de9f315-211e-4aef-b52c-4cf1104995f8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19422024-11-18T21:02:16.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de9f315-211e-4aef-b52c-4cf1104995f8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19432024-11-18T21:02:16.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de9f315-211e-4aef-b52c-4cf1104995f8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19442024-11-18T21:02:17.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1fbcde9d-6507-42c2-85fc-9b1552f53a37 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19452024-11-18T21:02:17.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1fbcde9d-6507-42c2-85fc-9b1552f53a37 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19462024-11-18T21:02:17.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1fbcde9d-6507-42c2-85fc-9b1552f53a37 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19472024-11-18T21:02:18.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8aabaf9b-aef6-4d0f-9474-1bafcc89ebed roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19482024-11-18T21:02:18.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8aabaf9b-aef6-4d0f-9474-1bafcc89ebed resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19492024-11-18T21:02:18.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8aabaf9b-aef6-4d0f-9474-1bafcc89ebed response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19502024-11-18T21:02:19.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58380fc3-885e-4ee1-985c-48cfbe012c90 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19512024-11-18T21:02:19.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58380fc3-885e-4ee1-985c-48cfbe012c90 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19522024-11-18T21:02:19.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58380fc3-885e-4ee1-985c-48cfbe012c90 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19532024-11-18T21:02:20.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0f48c8c-2559-48bc-a16e-82b5378cc0e0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19542024-11-18T21:02:20.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0f48c8c-2559-48bc-a16e-82b5378cc0e0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19552024-11-18T21:02:20.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0f48c8c-2559-48bc-a16e-82b5378cc0e0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19562024-11-18T21:02:21.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19b67b18-f4a9-4a1e-9539-372525c6fd34 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19572024-11-18T21:02:21.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19b67b18-f4a9-4a1e-9539-372525c6fd34 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19582024-11-18T21:02:21.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19b67b18-f4a9-4a1e-9539-372525c6fd34 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19592024-11-18T21:02:22.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ab44ffc-d897-49e3-9bf8-d3bc977673e7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19602024-11-18T21:02:22.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ab44ffc-d897-49e3-9bf8-d3bc977673e7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19612024-11-18T21:02:22.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ab44ffc-d897-49e3-9bf8-d3bc977673e7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19622024-11-18T21:02:23.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b89c063f-8a66-4c9d-855b-35de63c316b9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19632024-11-18T21:02:23.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b89c063f-8a66-4c9d-855b-35de63c316b9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19642024-11-18T21:02:23.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b89c063f-8a66-4c9d-855b-35de63c316b9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19652024-11-18T21:02:24.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 824f0c5d-e410-4db2-8418-d7768689ef99 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19662024-11-18T21:02:24.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 824f0c5d-e410-4db2-8418-d7768689ef99 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19672024-11-18T21:02:24.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 824f0c5d-e410-4db2-8418-d7768689ef99 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19682024-11-18T21:02:25.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85815ae7-c4da-4288-9850-c1b5f3dcc902 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19692024-11-18T21:02:25.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85815ae7-c4da-4288-9850-c1b5f3dcc902 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19702024-11-18T21:02:25.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85815ae7-c4da-4288-9850-c1b5f3dcc902 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19712024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
19722024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19732024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
19742024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19752024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19762024-11-18T21:02:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19772024-11-18T21:02:26.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19782024-11-18T21:02:26.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19792024-11-18T21:02:26.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19802024-11-18T21:02:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19812024-11-18T21:02:26.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19822024-11-18T21:02:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19832024-11-18T21:02:26.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19842024-11-18T21:02:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19852024-11-18T21:02:26.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19862024-11-18T21:02:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
19872024-11-18T21:02:26.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19882024-11-18T21:02:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19892024-11-18T21:02:26.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
19902024-11-18T21:02:26.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.011377ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
19912024-11-18T21:02:26.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.693442ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19922024-11-18T21:02:26.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a10a603-0e98-4502-b3b6-79d008768ef3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19932024-11-18T21:02:26.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a10a603-0e98-4502-b3b6-79d008768ef3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19942024-11-18T21:02:26.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a10a603-0e98-4502-b3b6-79d008768ef3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19952024-11-18T21:02:27.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ee73b1f-8654-4ba2-962e-8d20012c744f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19962024-11-18T21:02:27.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ee73b1f-8654-4ba2-962e-8d20012c744f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19972024-11-18T21:02:27.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ee73b1f-8654-4ba2-962e-8d20012c744f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19982024-11-18T21:02:28.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54a99c06-0228-492c-8c68-e34f37b70578 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
19992024-11-18T21:02:28.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54a99c06-0228-492c-8c68-e34f37b70578 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20002024-11-18T21:02:28.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54a99c06-0228-492c-8c68-e34f37b70578 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20012024-11-18T21:02:29.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5871245f-4621-47fc-8abb-3318128e44e1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20022024-11-18T21:02:29.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5871245f-4621-47fc-8abb-3318128e44e1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20032024-11-18T21:02:29.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5871245f-4621-47fc-8abb-3318128e44e1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20042024-11-18T21:02:30.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5881feef-277a-407d-875f-f4655a553004 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20052024-11-18T21:02:30.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5881feef-277a-407d-875f-f4655a553004 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20062024-11-18T21:02:30.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5881feef-277a-407d-875f-f4655a553004 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20072024-11-18T21:02:31.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3560a01c-ed5d-4a1a-b5d5-f83ff28b2ca1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20082024-11-18T21:02:31.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3560a01c-ed5d-4a1a-b5d5-f83ff28b2ca1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20092024-11-18T21:02:31.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3560a01c-ed5d-4a1a-b5d5-f83ff28b2ca1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20102024-11-18T21:02:32.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 726cee50-bddb-47d5-8978-b8e9cceadf66 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20112024-11-18T21:02:32.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 726cee50-bddb-47d5-8978-b8e9cceadf66 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20122024-11-18T21:02:32.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 726cee50-bddb-47d5-8978-b8e9cceadf66 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20132024-11-18T21:02:33.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e14cf30-7379-4570-a55f-9bba994470b8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20142024-11-18T21:02:33.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e14cf30-7379-4570-a55f-9bba994470b8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20152024-11-18T21:02:33.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e14cf30-7379-4570-a55f-9bba994470b8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20162024-11-18T21:02:35.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ecb7ee3-91b3-43f5-992c-7b4ded644bf7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20172024-11-18T21:02:35.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ecb7ee3-91b3-43f5-992c-7b4ded644bf7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20182024-11-18T21:02:35.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ecb7ee3-91b3-43f5-992c-7b4ded644bf7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20192024-11-18T21:02:36.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 384c72e0-b648-4bca-8431-38d8696cb078 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20202024-11-18T21:02:36.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 384c72e0-b648-4bca-8431-38d8696cb078 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20212024-11-18T21:02:36.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 384c72e0-b648-4bca-8431-38d8696cb078 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
20222024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
20232024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20242024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
20252024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20262024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20272024-11-18T21:02:36.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20282024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
20292024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20302024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20312024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
20322024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
20332024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20342024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
20352024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20362024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20372024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
20382024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
20392024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20402024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20412024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
20422024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
20432024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20442024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20452024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
20462024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20472024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
20482024-11-18T21:02:36.233ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20492024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
20502024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20512024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
20522024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20532024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20542024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
20552024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20562024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
20572024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
20582024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20592024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20602024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20612024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20622024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20632024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20642024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20652024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20662024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20672024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20682024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20692024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20702024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20712024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20722024-11-18T21:02:36.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20732024-11-18T21:02:36.234ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 556333674 } })
20742024-11-18T21:02:36.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
20752024-11-18T21:02:36.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 557338221 } })
20762024-11-18T21:02:36.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
20772024-11-18T21:02:36.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20782024-11-18T21:02:36.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20792024-11-18T21:02:36.236ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.564226ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20802024-11-18T21:02:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20812024-11-18T21:02:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20822024-11-18T21:02:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832024-11-18T21:02:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20842024-11-18T21:02:36.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20852024-11-18T21:02:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20862024-11-18T21:02:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20872024-11-18T21:02:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20882024-11-18T21:02:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20892024-11-18T21:02:36.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20902024-11-18T21:02:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20912024-11-18T21:02:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20922024-11-18T21:02:36.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20932024-11-18T21:02:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20942024-11-18T21:02:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20952024-11-18T21:02:36.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 574409259 } })
20962024-11-18T21:02:36.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
20972024-11-18T21:02:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
20982024-11-18T21:02:36.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20992024-11-18T21:02:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21002024-11-18T21:02:36.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21012024-11-18T21:02:36.283ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21022024-11-18T21:02:36.283ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21032024-11-18T21:02:36.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21042024-11-18T21:02:36.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21052024-11-18T21:02:36.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21062024-11-18T21:02:36.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072024-11-18T21:02:36.286ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21082024-11-18T21:02:36.286ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21092024-11-18T21:02:36.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21102024-11-18T21:02:36.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21112024-11-18T21:02:36.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.867779ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
21122024-11-18T21:02:36.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21132024-11-18T21:02:36.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21142024-11-18T21:02:36.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-11-18T21:02:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21162024-11-18T21:02:36.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21172024-11-18T21:02:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21182024-11-18T21:02:36.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21192024-11-18T21:02:36.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21202024-11-18T21:02:36.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21212024-11-18T21:02:36.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21222024-11-18T21:02:36.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21232024-11-18T21:02:36.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.826639ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
21242024-11-18T21:02:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21252024-11-18T21:02:36.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
21262024-11-18T21:02:36.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.501634ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
21272024-11-18T21:02:36.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282024-11-18T21:02:36.294ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21292024-11-18T21:02:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21302024-11-18T21:02:36.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21312024-11-18T21:02:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21322024-11-18T21:02:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21332024-11-18T21:02:36.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21342024-11-18T21:02:36.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21352024-11-18T21:02:36.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21362024-11-18T21:02:36.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.910687ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21372024-11-18T21:02:36.297ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21382024-11-18T21:02:36.297ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.625842ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21392024-11-18T21:02:36.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21402024-11-18T21:02:36.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21412024-11-18T21:02:36.310ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21422024-11-18T21:02:36.310ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21432024-11-18T21:02:36.310ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d77ae616-aa0c-442a-96a1-09b51b5f64e2", "content-length": "26", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
21442024-11-18T21:02:36.310ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21452024-11-18T21:02:36.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21462024-11-18T21:02:36.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.358082ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21472024-11-18T21:02:36.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.219071ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21482024-11-18T21:02:36.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21492024-11-18T21:02:36.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21502024-11-18T21:02:36.321ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21512024-11-18T21:02:36.321ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21522024-11-18T21:02:36.321ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.44909ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21532024-11-18T21:02:36.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21542024-11-18T21:02:36.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21552024-11-18T21:02:36.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562024-11-18T21:02:36.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21572024-11-18T21:02:36.325ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21582024-11-18T21:02:36.325ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21592024-11-18T21:02:36.325ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21602024-11-18T21:02:36.325ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05433244-f516-4cb1-91d6-b64ee064f561", "content-length": "26", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
21612024-11-18T21:02:36.325ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21622024-11-18T21:02:36.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21632024-11-18T21:02:36.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21642024-11-18T21:02:36.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21652024-11-18T21:02:36.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21662024-11-18T21:02:36.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21672024-11-18T21:02:36.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
21682024-11-18T21:02:36.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21692024-11-18T21:02:36.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21702024-11-18T21:02:36.329ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.816432ms iteration = 4 status = 0
21712024-11-18T21:02:36.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
21722024-11-18T21:02:36.334ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21732024-11-18T21:02:36.334ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44960c19-0c72-44c4-ba9a-68e15e06fb3a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
21742024-11-18T21:02:36.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21752024-11-18T21:02:36.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
21762024-11-18T21:02:36.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21772024-11-18T21:02:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21782024-11-18T21:02:36.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.898642ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21792024-11-18T21:02:36.386ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21802024-11-18T21:02:36.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a6a081-a769-41b1-8946-b6c5fcdf7493", "content-length": "1", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
21812024-11-18T21:02:36.388ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21822024-11-18T21:02:36.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21832024-11-18T21:02:36.401ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.757496ms iteration = 4 status = {}
21842024-11-18T21:02:36.424ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21852024-11-18T21:02:36.424ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21862024-11-18T21:02:36.426ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.063507ms iteration = 4 status = null
21872024-11-18T21:02:36.426ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.633454ms iteration = 6 status = {"physical_disks_added":0}
21882024-11-18T21:02:36.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21892024-11-18T21:02:36.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21902024-11-18T21:02:36.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912024-11-18T21:02:36.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21922024-11-18T21:02:36.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21932024-11-18T21:02:36.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21942024-11-18T21:02:36.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21952024-11-18T21:02:36.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21962024-11-18T21:02:36.476ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
21972024-11-18T21:02:36.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21982024-11-18T21:02:36.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21992024-11-18T21:02:36.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22002024-11-18T21:02:36.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22012024-11-18T21:02:36.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22022024-11-18T21:02:36.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22032024-11-18T21:02:36.481ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e41b96f2-493f-45aa-b575-be53cb009acc", "content-length": "372", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22042024-11-18T21:02:36.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22052024-11-18T21:02:36.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22062024-11-18T21:02:36.512ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22072024-11-18T21:02:36.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "734bb86b-48da-4a60-9b4d-821ee3bfcb0e", "content-length": "691", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22082024-11-18T21:02:36.513ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22092024-11-18T21:02:36.513ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22102024-11-18T21:02:36.513ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22112024-11-18T21:02:36.514ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 281.401248ms iteration = 4 status = {}
22122024-11-18T21:02:36.527ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22132024-11-18T21:02:36.527ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22142024-11-18T21:02:36.527ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d2181dd-54fb-4943-807c-6cd3eddabbee", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22152024-11-18T21:02:36.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22162024-11-18T21:02:36.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22172024-11-18T21:02:36.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22182024-11-18T21:02:36.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22192024-11-18T21:02:36.532ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22202024-11-18T21:02:36.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc1a70b9-fa14-4ffa-86b7-4bc41c216d60", "content-length": "134", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22212024-11-18T21:02:36.532ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22222024-11-18T21:02:36.532ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
22232024-11-18T21:02:36.533ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22242024-11-18T21:02:36.533ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22252024-11-18T21:02:36.533ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22262024-11-18T21:02:36.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22272024-11-18T21:02:36.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22282024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22292024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22302024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22312024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22322024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22332024-11-18T21:02:36.535ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
22342024-11-18T21:02:36.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22352024-11-18T21:02:36.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22362024-11-18T21:02:36.538ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22372024-11-18T21:02:36.538ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22382024-11-18T21:02:36.539ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "60be7f1c-d8b9-4aec-a3c9-02059eeba98a", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22392024-11-18T21:02:36.540ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.902349ms iteration = 4 status = {}
22402024-11-18T21:02:36.543ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22412024-11-18T21:02:36.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b87de3e-2646-463a-bf74-c4275dec9f7e", "content-length": "2", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22422024-11-18T21:02:36.543ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22432024-11-18T21:02:36.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2487c93-399a-4f42-8b3b-7fe3035d14e8", "content-length": "51", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22442024-11-18T21:02:36.544ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
22452024-11-18T21:02:36.544ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22462024-11-18T21:02:36.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e12ece70-0212-4a59-ac37-8335438bcd59", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22472024-11-18T21:02:36.628ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
22482024-11-18T21:02:36.628ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22492024-11-18T21:02:36.628ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9596c2c5-e53f-4c6f-806c-167d8d8fbd17", "content-length": "682", "date": "Mon, 18 Nov 2024 21:02:35 GMT"} })
22502024-11-18T21:02:36.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22512024-11-18T21:02:36.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22522024-11-18T21:02:36.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22532024-11-18T21:02:36.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22542024-11-18T21:02:36.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22552024-11-18T21:02:36.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22562024-11-18T21:02:36.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572024-11-18T21:02:36.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582024-11-18T21:02:36.659ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.929447ms iteration = 4 status = {}
22592024-11-18T21:02:37.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef9a859-21c4-4bf2-8fd5-5d4dec0e395d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22602024-11-18T21:02:37.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef9a859-21c4-4bf2-8fd5-5d4dec0e395d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22612024-11-18T21:02:37.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef9a859-21c4-4bf2-8fd5-5d4dec0e395d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22622024-11-18T21:02:38.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19a8bbc2-fe44-470f-aee5-da601e991744 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22632024-11-18T21:02:38.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19a8bbc2-fe44-470f-aee5-da601e991744 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22642024-11-18T21:02:38.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19a8bbc2-fe44-470f-aee5-da601e991744 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22652024-11-18T21:02:39.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 67c037a5-1701-4390-8229-36c5d42a3094 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22662024-11-18T21:02:39.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 67c037a5-1701-4390-8229-36c5d42a3094 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22672024-11-18T21:02:39.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 67c037a5-1701-4390-8229-36c5d42a3094 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22682024-11-18T21:02:40.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3d69f55-a375-4176-8fd0-b2200ec44746 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22692024-11-18T21:02:40.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3d69f55-a375-4176-8fd0-b2200ec44746 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22702024-11-18T21:02:40.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3d69f55-a375-4176-8fd0-b2200ec44746 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22712024-11-18T21:02:41.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 344ffa45-544b-4cc1-a2ad-e291973c9bf6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22722024-11-18T21:02:41.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 344ffa45-544b-4cc1-a2ad-e291973c9bf6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22732024-11-18T21:02:41.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 344ffa45-544b-4cc1-a2ad-e291973c9bf6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22742024-11-18T21:02:42.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7ed3d14-2aac-46f0-97e0-aa429ad6e43b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22752024-11-18T21:02:42.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7ed3d14-2aac-46f0-97e0-aa429ad6e43b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22762024-11-18T21:02:42.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7ed3d14-2aac-46f0-97e0-aa429ad6e43b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22772024-11-18T21:02:43.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 78efd00e-c13f-41a7-a1be-4ae36648d3c0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22782024-11-18T21:02:43.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 78efd00e-c13f-41a7-a1be-4ae36648d3c0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22792024-11-18T21:02:43.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 78efd00e-c13f-41a7-a1be-4ae36648d3c0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22802024-11-18T21:02:44.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9439ebb9-ee47-47f0-b76f-4c2d1863747a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22812024-11-18T21:02:44.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9439ebb9-ee47-47f0-b76f-4c2d1863747a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22822024-11-18T21:02:44.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9439ebb9-ee47-47f0-b76f-4c2d1863747a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22832024-11-18T21:02:45.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 153c4fdb-f327-462a-8002-391e7695f57d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22842024-11-18T21:02:45.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 153c4fdb-f327-462a-8002-391e7695f57d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22852024-11-18T21:02:45.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 153c4fdb-f327-462a-8002-391e7695f57d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22862024-11-18T21:02:46.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
22872024-11-18T21:02:46.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
22882024-11-18T21:02:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22892024-11-18T21:02:46.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22902024-11-18T21:02:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22912024-11-18T21:02:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22922024-11-18T21:02:46.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9d53b4c-3cfe-4aec-bca4-19d0a4d891d7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22932024-11-18T21:02:46.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9d53b4c-3cfe-4aec-bca4-19d0a4d891d7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22942024-11-18T21:02:46.265ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22952024-11-18T21:02:46.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22962024-11-18T21:02:46.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9d53b4c-3cfe-4aec-bca4-19d0a4d891d7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
22972024-11-18T21:02:46.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982024-11-18T21:02:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22992024-11-18T21:02:46.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23002024-11-18T21:02:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23012024-11-18T21:02:46.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-11-18T21:02:46.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23032024-11-18T21:02:46.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042024-11-18T21:02:46.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
23052024-11-18T21:02:46.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23062024-11-18T21:02:46.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072024-11-18T21:02:46.290ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
23082024-11-18T21:02:46.290ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.300183ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
23092024-11-18T21:02:46.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.295835ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23102024-11-18T21:02:47.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1ae520c-9f94-490f-b8bf-833d583e1a6c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23112024-11-18T21:02:47.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1ae520c-9f94-490f-b8bf-833d583e1a6c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23122024-11-18T21:02:47.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1ae520c-9f94-490f-b8bf-833d583e1a6c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23132024-11-18T21:02:48.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d3ee20f-191a-4f69-9c03-6f9b4f2bd933 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23142024-11-18T21:02:48.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d3ee20f-191a-4f69-9c03-6f9b4f2bd933 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23152024-11-18T21:02:48.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d3ee20f-191a-4f69-9c03-6f9b4f2bd933 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23162024-11-18T21:02:49.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df19cb28-9672-46c2-b109-fb00fdd159a3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23172024-11-18T21:02:49.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df19cb28-9672-46c2-b109-fb00fdd159a3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23182024-11-18T21:02:49.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df19cb28-9672-46c2-b109-fb00fdd159a3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23192024-11-18T21:02:50.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96e552e4-c38e-4962-a84d-0884f62a894b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23202024-11-18T21:02:50.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96e552e4-c38e-4962-a84d-0884f62a894b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23212024-11-18T21:02:50.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96e552e4-c38e-4962-a84d-0884f62a894b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23222024-11-18T21:02:51.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70424ab8-9363-48bc-9b97-b2cc361dcae2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23232024-11-18T21:02:51.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70424ab8-9363-48bc-9b97-b2cc361dcae2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23242024-11-18T21:02:51.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70424ab8-9363-48bc-9b97-b2cc361dcae2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23252024-11-18T21:02:52.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 961a26c5-6eeb-4d69-b04a-cbac7ffb6dd9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23262024-11-18T21:02:52.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 961a26c5-6eeb-4d69-b04a-cbac7ffb6dd9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23272024-11-18T21:02:52.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 961a26c5-6eeb-4d69-b04a-cbac7ffb6dd9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23282024-11-18T21:02:53.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a60c3c6b-2f55-4248-94f3-f1b0d2f328df roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23292024-11-18T21:02:53.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a60c3c6b-2f55-4248-94f3-f1b0d2f328df resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23302024-11-18T21:02:53.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a60c3c6b-2f55-4248-94f3-f1b0d2f328df response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23312024-11-18T21:02:54.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 543a2c03-bf75-4509-b0df-3c835bf14a36 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23322024-11-18T21:02:54.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 543a2c03-bf75-4509-b0df-3c835bf14a36 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23332024-11-18T21:02:54.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 543a2c03-bf75-4509-b0df-3c835bf14a36 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23342024-11-18T21:02:55.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55675673-fabf-4e3e-aaab-d75a4afd7290 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23352024-11-18T21:02:55.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55675673-fabf-4e3e-aaab-d75a4afd7290 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23362024-11-18T21:02:55.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55675673-fabf-4e3e-aaab-d75a4afd7290 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23372024-11-18T21:02:56.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
23382024-11-18T21:02:56.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
23392024-11-18T21:02:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23402024-11-18T21:02:56.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23412024-11-18T21:02:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23422024-11-18T21:02:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23432024-11-18T21:02:56.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442024-11-18T21:02:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23452024-11-18T21:02:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23462024-11-18T21:02:56.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.10403ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23472024-11-18T21:02:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23482024-11-18T21:02:56.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23492024-11-18T21:02:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23502024-11-18T21:02:56.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23512024-11-18T21:02:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23522024-11-18T21:02:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23532024-11-18T21:02:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
23542024-11-18T21:02:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23552024-11-18T21:02:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23562024-11-18T21:02:56.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
23572024-11-18T21:02:56.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.601096ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
23582024-11-18T21:02:56.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e412149-9ee2-4642-8e07-11c3865ba8d4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23592024-11-18T21:02:56.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e412149-9ee2-4642-8e07-11c3865ba8d4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23602024-11-18T21:02:56.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e412149-9ee2-4642-8e07-11c3865ba8d4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23612024-11-18T21:02:57.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eb06b54-096e-4e82-9c34-8a326f8376b7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23622024-11-18T21:02:57.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eb06b54-096e-4e82-9c34-8a326f8376b7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23632024-11-18T21:02:57.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eb06b54-096e-4e82-9c34-8a326f8376b7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23642024-11-18T21:02:58.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 03ef53e1-1e24-4718-b979-67e8200402e6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23652024-11-18T21:02:58.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 03ef53e1-1e24-4718-b979-67e8200402e6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23662024-11-18T21:02:58.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 03ef53e1-1e24-4718-b979-67e8200402e6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23672024-11-18T21:02:59.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92a087e4-8084-46b2-874e-2034f7560aec roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23682024-11-18T21:02:59.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92a087e4-8084-46b2-874e-2034f7560aec resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23692024-11-18T21:02:59.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92a087e4-8084-46b2-874e-2034f7560aec response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23702024-11-18T21:03:00.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a8d416b-8ff9-4639-8f63-1477c0661db0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23712024-11-18T21:03:00.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a8d416b-8ff9-4639-8f63-1477c0661db0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23722024-11-18T21:03:00.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a8d416b-8ff9-4639-8f63-1477c0661db0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23732024-11-18T21:03:01.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86076179-7ffc-4a10-bd7c-f33894890dff roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23742024-11-18T21:03:01.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86076179-7ffc-4a10-bd7c-f33894890dff resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23752024-11-18T21:03:01.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86076179-7ffc-4a10-bd7c-f33894890dff response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23762024-11-18T21:03:02.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 224458a2-0b6f-4dfd-94da-c77ba22b8e65 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23772024-11-18T21:03:02.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 224458a2-0b6f-4dfd-94da-c77ba22b8e65 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23782024-11-18T21:03:02.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 224458a2-0b6f-4dfd-94da-c77ba22b8e65 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23792024-11-18T21:03:03.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a368aa-4cb5-4b72-8119-494dd9c2e2a3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23802024-11-18T21:03:03.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a368aa-4cb5-4b72-8119-494dd9c2e2a3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23812024-11-18T21:03:03.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a368aa-4cb5-4b72-8119-494dd9c2e2a3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23822024-11-18T21:03:04.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 457835fb-f0d4-4437-8438-1fa6f44339dc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23832024-11-18T21:03:04.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 457835fb-f0d4-4437-8438-1fa6f44339dc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23842024-11-18T21:03:04.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 457835fb-f0d4-4437-8438-1fa6f44339dc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23852024-11-18T21:03:05.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 512b8444-0e58-4ee3-8ab8-8b182ba48f0e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23862024-11-18T21:03:05.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 512b8444-0e58-4ee3-8ab8-8b182ba48f0e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23872024-11-18T21:03:05.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 512b8444-0e58-4ee3-8ab8-8b182ba48f0e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
23882024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
23892024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
23902024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23912024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
23922024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23932024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
23942024-11-18T21:03:06.237ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
23952024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 10.15\u{b5}s iteration = 4 status = {"error":"no config"}
23962024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
23972024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23982024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
23992024-11-18T21:03:06.237ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:53:06.237312272 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24002024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24012024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
24022024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24032024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
24042024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24052024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24062024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24072024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
24082024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
24092024-11-18T21:03:06.237ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
24102024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 12.03\u{b5}s iteration = 4 status = {"error":"no config"}
24112024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
24122024-11-18T21:03:06.237ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24132024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
24142024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24152024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24162024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
24172024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
24182024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24192024-11-18T21:03:06.237ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
24202024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
24212024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
24222024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.87\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
24232024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
24242024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
24252024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24262024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
24272024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24282024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24292024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24302024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24312024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
24322024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24332024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24342024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
24352024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24362024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
24372024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24382024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
24392024-11-18T21:03:06.237ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24402024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24412024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
24422024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24432024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
24442024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24452024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
24462024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24472024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
24482024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24492024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
24502024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24512024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
24522024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24532024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
24542024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24552024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24562024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24572024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24582024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24592024-11-18T21:03:06.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 554656501 } })
24602024-11-18T21:03:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24612024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24622024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24632024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24642024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24652024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24662024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24672024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24682024-11-18T21:03:06.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 554876933 } })
24692024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24702024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24712024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24722024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24732024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24742024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24752024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24762024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24772024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24782024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24792024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24802024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24812024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.163639ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24822024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24832024-11-18T21:03:06.238ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.331341ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24842024-11-18T21:03:06.240ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.65896ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24852024-11-18T21:03:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24862024-11-18T21:03:06.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 557807695 } })
24872024-11-18T21:03:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24882024-11-18T21:03:06.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892024-11-18T21:03:06.241ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:53:06.237312272 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24902024-11-18T21:03:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.94846ms iteration = 3 status = {"expiration":"2024-11-18T20:53:06.237312272Z","pruned":[]}
24912024-11-18T21:03:06.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
24922024-11-18T21:03:06.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 559595509 } })
24932024-11-18T21:03:06.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
24942024-11-18T21:03:06.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24952024-11-18T21:03:06.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24962024-11-18T21:03:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24972024-11-18T21:03:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24982024-11-18T21:03:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24992024-11-18T21:03:06.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002024-11-18T21:03:06.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012024-11-18T21:03:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25022024-11-18T21:03:06.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25032024-11-18T21:03:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25042024-11-18T21:03:06.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25052024-11-18T21:03:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25062024-11-18T21:03:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25072024-11-18T21:03:06.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25082024-11-18T21:03:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25092024-11-18T21:03:06.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25102024-11-18T21:03:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25112024-11-18T21:03:06.252ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.610039ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
25122024-11-18T21:03:06.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25132024-11-18T21:03:06.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25142024-11-18T21:03:06.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25152024-11-18T21:03:06.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25162024-11-18T21:03:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25172024-11-18T21:03:06.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25182024-11-18T21:03:06.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25192024-11-18T21:03:06.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25202024-11-18T21:03:06.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25212024-11-18T21:03:06.263ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25222024-11-18T21:03:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25232024-11-18T21:03:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25242024-11-18T21:03:06.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25252024-11-18T21:03:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25262024-11-18T21:03:06.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25272024-11-18T21:03:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25282024-11-18T21:03:06.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25292024-11-18T21:03:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25302024-11-18T21:03:06.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312024-11-18T21:03:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25322024-11-18T21:03:06.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25332024-11-18T21:03:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25342024-11-18T21:03:06.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25352024-11-18T21:03:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25362024-11-18T21:03:06.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372024-11-18T21:03:06.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25382024-11-18T21:03:06.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392024-11-18T21:03:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25402024-11-18T21:03:06.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25412024-11-18T21:03:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25422024-11-18T21:03:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25432024-11-18T21:03:06.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25442024-11-18T21:03:06.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.434551ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
25452024-11-18T21:03:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25462024-11-18T21:03:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
25472024-11-18T21:03:06.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25482024-11-18T21:03:06.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25492024-11-18T21:03:06.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25502024-11-18T21:03:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25512024-11-18T21:03:06.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25522024-11-18T21:03:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25532024-11-18T21:03:06.297ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25542024-11-18T21:03:06.297ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25552024-11-18T21:03:06.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25562024-11-18T21:03:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25572024-11-18T21:03:06.301ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25582024-11-18T21:03:06.301ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25592024-11-18T21:03:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.486354ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25602024-11-18T21:03:06.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25612024-11-18T21:03:06.301ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 618304236 } })
25622024-11-18T21:03:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25632024-11-18T21:03:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.167039ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
25642024-11-18T21:03:06.301ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
25652024-11-18T21:03:06.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.229304ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25662024-11-18T21:03:06.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.773488ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25672024-11-18T21:03:06.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.857339ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25692024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25702024-11-18T21:03:06.312ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25712024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.11466ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25722024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25732024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25742024-11-18T21:03:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25752024-11-18T21:03:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25762024-11-18T21:03:06.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.784182ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25772024-11-18T21:03:06.314ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25782024-11-18T21:03:06.314ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25792024-11-18T21:03:06.314ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7bb8123-ef03-44c8-8ed4-c03d54e11d95", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
25802024-11-18T21:03:06.314ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25812024-11-18T21:03:06.316ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25822024-11-18T21:03:06.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832024-11-18T21:03:06.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842024-11-18T21:03:06.317ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25852024-11-18T21:03:06.317ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25862024-11-18T21:03:06.317ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25872024-11-18T21:03:06.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25882024-11-18T21:03:06.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25892024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
25902024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.647189ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
25912024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25922024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25932024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25942024-11-18T21:03:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25952024-11-18T21:03:06.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25962024-11-18T21:03:06.322ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25972024-11-18T21:03:06.322ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25982024-11-18T21:03:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25992024-11-18T21:03:06.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26002024-11-18T21:03:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26012024-11-18T21:03:06.322ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "874c8eda-b37a-41b5-9be8-4862cfde8f9a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
26022024-11-18T21:03:06.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26032024-11-18T21:03:06.324ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26042024-11-18T21:03:06.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26052024-11-18T21:03:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26062024-11-18T21:03:06.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26072024-11-18T21:03:06.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26082024-11-18T21:03:06.335ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26092024-11-18T21:03:06.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26102024-11-18T21:03:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26112024-11-18T21:03:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26122024-11-18T21:03:06.340ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26132024-11-18T21:03:06.340ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26142024-11-18T21:03:06.340ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26152024-11-18T21:03:06.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26162024-11-18T21:03:06.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26172024-11-18T21:03:06.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26182024-11-18T21:03:06.344ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26192024-11-18T21:03:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26202024-11-18T21:03:06.358ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26212024-11-18T21:03:06.358ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
26222024-11-18T21:03:06.358ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.764041ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26232024-11-18T21:03:06.360ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26242024-11-18T21:03:06.361ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26252024-11-18T21:03:06.361ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26262024-11-18T21:03:06.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26272024-11-18T21:03:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26282024-11-18T21:03:06.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26292024-11-18T21:03:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26302024-11-18T21:03:06.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26312024-11-18T21:03:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26322024-11-18T21:03:06.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26332024-11-18T21:03:06.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26342024-11-18T21:03:06.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26352024-11-18T21:03:06.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26362024-11-18T21:03:06.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26372024-11-18T21:03:06.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26382024-11-18T21:03:06.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26392024-11-18T21:03:06.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26402024-11-18T21:03:06.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26412024-11-18T21:03:06.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
26422024-11-18T21:03:06.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26432024-11-18T21:03:06.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26442024-11-18T21:03:06.378ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26452024-11-18T21:03:06.378ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 140.83862ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26462024-11-18T21:03:06.379ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 141.653946ms iteration = 5 status = 0
26472024-11-18T21:03:06.379ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26482024-11-18T21:03:06.379ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26492024-11-18T21:03:06.379ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
26502024-11-18T21:03:06.379ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 142.530914ms iteration = 3 status = {"generation":1}
26512024-11-18T21:03:06.379ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Dependency
26522024-11-18T21:03:06.385ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26532024-11-18T21:03:06.385ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26542024-11-18T21:03:06.385ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.628472ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26552024-11-18T21:03:06.391ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
26562024-11-18T21:03:06.391ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26572024-11-18T21:03:06.391ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d86fd4b3-b841-463d-bbaa-cb6c43763dec", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
26582024-11-18T21:03:06.391ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26592024-11-18T21:03:06.392ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
26602024-11-18T21:03:06.394ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
26612024-11-18T21:03:06.394ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.276433ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26622024-11-18T21:03:06.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26632024-11-18T21:03:06.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26642024-11-18T21:03:06.398ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26652024-11-18T21:03:06.398ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
26662024-11-18T21:03:06.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26672024-11-18T21:03:06.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26682024-11-18T21:03:06.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-11-18T21:03:06.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26702024-11-18T21:03:06.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26712024-11-18T21:03:06.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26722024-11-18T21:03:06.407ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
26732024-11-18T21:03:06.407ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26742024-11-18T21:03:06.407ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
26752024-11-18T21:03:06.407ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 170.491912ms iteration = 3 status = {"generation":2}
26762024-11-18T21:03:06.407ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Dependency
26772024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
26782024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
26792024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
26802024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
26812024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
26822024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
26832024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
26842024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
26852024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
26862024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
26872024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
26882024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
26892024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
26902024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
26912024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
26922024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
26932024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
26942024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
26952024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
26962024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
26972024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
26982024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
26992024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
27002024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
27012024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
27022024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
27032024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
27042024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
27052024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
27062024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
27072024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
27082024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
27092024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
27102024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
27112024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
27122024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
27132024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
27142024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
27152024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
27162024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
27172024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
27182024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
27192024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
27202024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
27212024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
27222024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
27232024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
27242024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
27252024-11-18T21:03:06.408ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
27262024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
27272024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
27282024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
27292024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
27302024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
27312024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
27322024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
27332024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
27342024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
27352024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
27362024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
27372024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
27382024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
27392024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
27402024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
27412024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
27422024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
27432024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
27442024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
27452024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
27462024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
27472024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
27482024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
27492024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
27502024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
27512024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
27522024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
27532024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
27542024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
27552024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
27562024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
27572024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
27582024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
27592024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
27602024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
27612024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
27622024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
27632024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
27642024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
27652024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
27662024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
27672024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
27682024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
27692024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
27702024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
27712024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
27722024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
27732024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
27742024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
27752024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
27762024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
27772024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
27782024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
27792024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
27802024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
27812024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
27822024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
27832024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
27842024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
27852024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
27862024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
27872024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
27882024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
27892024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
27902024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
27912024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
27922024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
27932024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
27942024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
27952024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
27962024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
27972024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
27982024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
27992024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
28002024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
28012024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
28022024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
28032024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
28042024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
28052024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
28062024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
28072024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
28082024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
28092024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
28102024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
28112024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
28122024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
28132024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
28142024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
28152024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
28162024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
28172024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
28182024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
28192024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
28202024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
28212024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
28222024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
28232024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
28242024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
28252024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
28262024-11-18T21:03:06.409ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
28272024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
28282024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
28292024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
28302024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
28312024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
28322024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
28332024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
28342024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
28352024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
28362024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
28372024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
28382024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
28392024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
28402024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
28412024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
28422024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
28432024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
28442024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
28452024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
28462024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
28472024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
28482024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
28492024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
28502024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
28512024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
28522024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
28532024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
28542024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
28552024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
28562024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
28572024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
28582024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
28592024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
28602024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
28612024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
28622024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
28632024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
28642024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
28652024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
28662024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
28672024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
28682024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
28692024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
28702024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
28712024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
28722024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
28732024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
28742024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
28752024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
28762024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
28772024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
28782024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
28792024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
28802024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
28812024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
28822024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
28832024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
28842024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
28852024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
28862024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
28872024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
28882024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
28892024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
28902024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
28912024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
28922024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
28932024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
28942024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
28952024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
28962024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
28972024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
28982024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
28992024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
29002024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
29012024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
29022024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
29032024-11-18T21:03:06.410ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
29042024-11-18T21:03:06.410ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
29052024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
29062024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
29072024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
29082024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
29092024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
29102024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
29112024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
29122024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
29132024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
29142024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
29152024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
29162024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
29172024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
29182024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
29192024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
29202024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
29212024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
29222024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
29232024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
29242024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
29252024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
29262024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
29272024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
29282024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
29292024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
29302024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
29312024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
29322024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
29332024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
29342024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
29352024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
29362024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
29372024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
29382024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
29392024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
29402024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
29412024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
29422024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
29432024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
29442024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
29452024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
29462024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
29472024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
29482024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
29492024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
29502024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
29512024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
29522024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
29532024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
29542024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
29552024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
29562024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
29572024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
29582024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
29592024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
29602024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
29612024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
29622024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
29632024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
29642024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
29652024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
29662024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
29672024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
29682024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
29692024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
29702024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
29712024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
29722024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
29732024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
29742024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
29752024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
29762024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
29772024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
29782024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
29792024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
29802024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
29812024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
29822024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
29832024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
29842024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
29852024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
29862024-11-18T21:03:06.417ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
29872024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
29882024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
29892024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
29902024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
29912024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
29922024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
29932024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
29942024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
29952024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
29962024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
29972024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
29982024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
29992024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
30002024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
30012024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
30022024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
30032024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
30042024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
30052024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
30062024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
30072024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
30082024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
30092024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
30102024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
30112024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
30122024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
30132024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
30142024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
30152024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
30162024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
30172024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
30182024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
30192024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
30202024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
30212024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
30222024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
30232024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
30242024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
30252024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
30262024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
30272024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
30282024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
30292024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
30302024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
30312024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
30322024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
30332024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
30342024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
30352024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
30362024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
30372024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
30382024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
30392024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
30402024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
30412024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
30422024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
30432024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
30442024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
30452024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
30462024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
30472024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
30482024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
30492024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
30502024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
30512024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
30522024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
30532024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
30542024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
30552024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
30562024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
30572024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
30582024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
30592024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
30602024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
30612024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
30622024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
30632024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
30642024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
30652024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
30662024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
30672024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
30682024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
30692024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
30702024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
30712024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
30722024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
30732024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
30742024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
30752024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
30762024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
30772024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
30782024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
30792024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
30802024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
30812024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
30822024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
30832024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
30842024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
30852024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
30862024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
30872024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
30882024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
30892024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
30902024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
30912024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
30922024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
30932024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
30942024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
30952024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
30962024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
30972024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
30982024-11-18T21:03:06.418ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
30992024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
31002024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
31012024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
31022024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
31032024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
31042024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
31052024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
31062024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
31072024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
31082024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
31092024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
31102024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
31112024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
31122024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
31132024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
31142024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
31152024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
31162024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
31172024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
31182024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
31192024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
31202024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
31212024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
31222024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
31232024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
31242024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
31252024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
31262024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
31272024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
31282024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
31292024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
31302024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
31312024-11-18T21:03:06.419ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
31322024-11-18T21:03:06.419ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
31332024-11-18T21:03:06.419ZDEBGnexus (nexus-producer-server): registered DTrace probes
31342024-11-18T21:03:06.422ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.193582ms iteration = 7 status = {"physical_disks_added":0}
31352024-11-18T21:03:06.423ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:64858 method = GET path = /{producer_id} versions = all
31362024-11-18T21:03:06.424ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:64858
31372024-11-18T21:03:06.424ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:64858
31382024-11-18T21:03:06.424ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:64858
31392024-11-18T21:03:06.425ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
31402024-11-18T21:03:06.425ZDEBGnexus (nexus-producer-server): starting producer registration task
31412024-11-18T21:03:06.425ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:64858 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
31422024-11-18T21:03:06.425ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31432024-11-18T21:03:06.425ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
31442024-11-18T21:03:06.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31452024-11-18T21:03:06.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31462024-11-18T21:03:06.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31472024-11-18T21:03:06.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31482024-11-18T21:03:06.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31492024-11-18T21:03:06.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31502024-11-18T21:03:06.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512024-11-18T21:03:06.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31522024-11-18T21:03:06.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31532024-11-18T21:03:06.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31542024-11-18T21:03:06.531ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31552024-11-18T21:03:06.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 328.053697ms iteration = 5 status = {}
31562024-11-18T21:03:06.595ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31572024-11-18T21:03:06.595ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31582024-11-18T21:03:06.595ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "09052935-e9c0-41d7-a297-7cf5fb20140d", "content-length": "372", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
31592024-11-18T21:03:06.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31602024-11-18T21:03:06.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31612024-11-18T21:03:06.595ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31622024-11-18T21:03:06.595ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a95969-4099-459f-954f-fe96beff5740", "content-length": "1", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
31632024-11-18T21:03:06.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31642024-11-18T21:03:06.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31652024-11-18T21:03:06.598ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 361.430096ms iteration = 5 status = null
31662024-11-18T21:03:06.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31672024-11-18T21:03:06.619ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31682024-11-18T21:03:06.619ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:53933
31692024-11-18T21:03:06.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53933 req_id = 285d50e6-3236-4480-9692-ef72e164cd4d roles = RoleSet { roles: {} } uri = /metrics/producers
31702024-11-18T21:03:06.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53933 req_id = 285d50e6-3236-4480-9692-ef72e164cd4d resource = Database result = Ok(()) uri = /metrics/producers
31712024-11-18T21:03:06.637ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31722024-11-18T21:03:06.637ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31732024-11-18T21:03:06.637ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b732abbc-10b2-4dc6-8e3e-b2ddc5e852e5", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
31742024-11-18T21:03:06.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31752024-11-18T21:03:06.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31762024-11-18T21:03:06.659ZINFOnexus: assigned collector to new producer collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 file = nexus/src/app/oximeter.rs:76 producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
31772024-11-18T21:03:06.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39284 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53933 req_id = 285d50e6-3236-4480-9692-ef72e164cd4d response_code = 201 uri = /metrics/producers
31782024-11-18T21:03:06.659ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "285d50e6-3236-4480-9692-ef72e164cd4d", "content-length": "41", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
31792024-11-18T21:03:06.660ZDEBGnexus (producer-registration-task): registered with nexus successfully
31802024-11-18T21:03:06.660ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31812024-11-18T21:03:06.665ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31822024-11-18T21:03:06.668ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31832024-11-18T21:03:06.668ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "453f54e7-ba9a-4125-9e2b-e3b16dc3b678", "content-length": "691", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
31842024-11-18T21:03:06.668ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31852024-11-18T21:03:06.668ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31862024-11-18T21:03:06.668ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31872024-11-18T21:03:06.669ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 431.67727ms iteration = 5 status = {}
31882024-11-18T21:03:06.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31892024-11-18T21:03:06.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31902024-11-18T21:03:06.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31912024-11-18T21:03:06.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31922024-11-18T21:03:06.677ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31932024-11-18T21:03:06.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31942024-11-18T21:03:06.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31952024-11-18T21:03:06.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0530ab78-6373-4bb8-8364-f8c6e898c2dd", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31962024-11-18T21:03:06.697ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31972024-11-18T21:03:06.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1a6f51cf-e438-470d-8694-3d1c4195f29b", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31982024-11-18T21:03:06.698ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31992024-11-18T21:03:06.700ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32002024-11-18T21:03:06.700ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 292.368581ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32012024-11-18T21:03:06.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32022024-11-18T21:03:06.739ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6e875c57-8fa7-40e1-8f7e-d3a9db406ec5", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32032024-11-18T21:03:06.739ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32042024-11-18T21:03:06.740ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "00852534-457f-4191-b04f-d4ac394cd8ab", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32052024-11-18T21:03:06.740ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32062024-11-18T21:03:06.742ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "766ed374-d3a2-4be3-9408-5153f0ae4d1e", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32072024-11-18T21:03:06.742ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32082024-11-18T21:03:06.743ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
32092024-11-18T21:03:06.743ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 364.031615ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32102024-11-18T21:03:06.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32112024-11-18T21:03:06.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32122024-11-18T21:03:06.745ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
32132024-11-18T21:03:06.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32142024-11-18T21:03:06.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32152024-11-18T21:03:06.755ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32162024-11-18T21:03:06.755ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4572f9fb-16b1-4137-afdd-a446074ece0f", "content-length": "134", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
32172024-11-18T21:03:06.755ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32182024-11-18T21:03:06.755ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
32192024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32202024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32212024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32222024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32232024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32242024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32252024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32262024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32272024-11-18T21:03:06.756ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
32282024-11-18T21:03:06.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32292024-11-18T21:03:06.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32302024-11-18T21:03:06.758ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32312024-11-18T21:03:06.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b2e3ec6-4e77-4af8-967a-66ac2b0b55f8", "content-length": "2", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
32322024-11-18T21:03:06.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32332024-11-18T21:03:06.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a273cae3-a579-4008-a677-e8aae744485d", "content-length": "51", "date": "Mon, 18 Nov 2024 21:03:05 GMT"} })
32342024-11-18T21:03:06.759ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
32352024-11-18T21:03:06.759ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32362024-11-18T21:03:06.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a2a2284-93fb-4789-9928-a99f5b3e84f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32372024-11-18T21:03:06.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a2a2284-93fb-4789-9928-a99f5b3e84f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32382024-11-18T21:03:06.759ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "abc99a8b-b356-4645-a715-7c7fc660098f", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
32392024-11-18T21:03:06.761ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 523.534895ms iteration = 5 status = {}
32402024-11-18T21:03:06.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a2a2284-93fb-4789-9928-a99f5b3e84f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32412024-11-18T21:03:06.847ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "856bbea0-f29a-4391-b115-5626f9f1bfd7", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
32422024-11-18T21:03:06.847ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
32432024-11-18T21:03:06.847ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32442024-11-18T21:03:06.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "05086804-659a-4b3d-8d6d-96d5a2689aa9", "content-length": "682", "date": "Mon, 18 Nov 2024 21:03:06 GMT"} })
32452024-11-18T21:03:06.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32462024-11-18T21:03:06.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32472024-11-18T21:03:06.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32482024-11-18T21:03:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32492024-11-18T21:03:06.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32502024-11-18T21:03:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32512024-11-18T21:03:06.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32522024-11-18T21:03:06.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32532024-11-18T21:03:06.865ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.789993ms iteration = 5 status = {}
32542024-11-18T21:03:07.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a99ac2a-0a4e-497f-ad8f-144454e1e184 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32552024-11-18T21:03:07.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a99ac2a-0a4e-497f-ad8f-144454e1e184 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32562024-11-18T21:03:07.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a99ac2a-0a4e-497f-ad8f-144454e1e184 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32572024-11-18T21:03:08.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = db788820-a25b-4220-a81b-fe93883131f5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32582024-11-18T21:03:08.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = db788820-a25b-4220-a81b-fe93883131f5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32592024-11-18T21:03:08.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = db788820-a25b-4220-a81b-fe93883131f5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32602024-11-18T21:03:09.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2b000f47-aaf3-4b6c-ba9d-fca6c804c1e6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32612024-11-18T21:03:09.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2b000f47-aaf3-4b6c-ba9d-fca6c804c1e6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32622024-11-18T21:03:09.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2b000f47-aaf3-4b6c-ba9d-fca6c804c1e6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32632024-11-18T21:03:10.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6562b06c-a73c-4bb6-bb68-ad78bf74e995 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32642024-11-18T21:03:10.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6562b06c-a73c-4bb6-bb68-ad78bf74e995 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32652024-11-18T21:03:10.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6562b06c-a73c-4bb6-bb68-ad78bf74e995 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32662024-11-18T21:03:10.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 473046d7-5dfa-48d2-a6d7-2167ca85d9d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
32672024-11-18T21:03:10.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 473046d7-5dfa-48d2-a6d7-2167ca85d9d3 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
32682024-11-18T21:03:10.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 473046d7-5dfa-48d2-a6d7-2167ca85d9d3 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
32692024-11-18T21:03:10.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = efbd1f4c-1af0-4b77-9c49-0dc775dc9efc roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
32702024-11-18T21:03:10.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = efbd1f4c-1af0-4b77-9c49-0dc775dc9efc resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
32712024-11-18T21:03:10.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = efbd1f4c-1af0-4b77-9c49-0dc775dc9efc response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
32722024-11-18T21:03:10.942ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:64858 remote_addr = [fd00:1122:3344:101::d]:52336
32732024-11-18T21:03:10.944ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1415 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = e2da1815-ed46-420d-ace2-b0ef8c386342 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
32742024-11-18T21:03:11.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d6a04e8-d549-47fd-b432-25aadb22081b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32752024-11-18T21:03:11.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d6a04e8-d549-47fd-b432-25aadb22081b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32762024-11-18T21:03:11.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d6a04e8-d549-47fd-b432-25aadb22081b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32772024-11-18T21:03:12.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9c47bca-f474-476a-9b2a-0c6f65aeb36b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32782024-11-18T21:03:12.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9c47bca-f474-476a-9b2a-0c6f65aeb36b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32792024-11-18T21:03:12.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9c47bca-f474-476a-9b2a-0c6f65aeb36b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32802024-11-18T21:03:13.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c81e6bfa-be4f-45de-8308-e8cb924af723 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32812024-11-18T21:03:13.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c81e6bfa-be4f-45de-8308-e8cb924af723 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32822024-11-18T21:03:13.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c81e6bfa-be4f-45de-8308-e8cb924af723 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32832024-11-18T21:03:14.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a37a0ad7-2a35-48fb-9602-f4ab6073359c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32842024-11-18T21:03:14.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a37a0ad7-2a35-48fb-9602-f4ab6073359c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32852024-11-18T21:03:14.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a37a0ad7-2a35-48fb-9602-f4ab6073359c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32862024-11-18T21:03:15.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e7d8d493-af68-4bad-bd45-6c5851c2af5f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32872024-11-18T21:03:15.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e7d8d493-af68-4bad-bd45-6c5851c2af5f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32882024-11-18T21:03:15.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e7d8d493-af68-4bad-bd45-6c5851c2af5f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
32892024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
32902024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
32912024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32922024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32932024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32942024-11-18T21:03:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32952024-11-18T21:03:16.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32962024-11-18T21:03:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32972024-11-18T21:03:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-11-18T21:03:16.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.975263ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32992024-11-18T21:03:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33002024-11-18T21:03:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33012024-11-18T21:03:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33022024-11-18T21:03:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33032024-11-18T21:03:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33042024-11-18T21:03:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33052024-11-18T21:03:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
33062024-11-18T21:03:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33072024-11-18T21:03:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33082024-11-18T21:03:16.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
33092024-11-18T21:03:16.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.101032ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
33102024-11-18T21:03:16.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f28526fb-19ec-465b-89d3-a34ed8e2e5e6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33112024-11-18T21:03:16.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f28526fb-19ec-465b-89d3-a34ed8e2e5e6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33122024-11-18T21:03:16.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f28526fb-19ec-465b-89d3-a34ed8e2e5e6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33132024-11-18T21:03:17.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71e3b659-c7c8-45e5-abef-a6c0b5417b4f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33142024-11-18T21:03:17.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71e3b659-c7c8-45e5-abef-a6c0b5417b4f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33152024-11-18T21:03:17.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71e3b659-c7c8-45e5-abef-a6c0b5417b4f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33162024-11-18T21:03:19.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47db5923-cd6d-4271-8871-aa3d15f07040 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33172024-11-18T21:03:19.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47db5923-cd6d-4271-8871-aa3d15f07040 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33182024-11-18T21:03:19.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47db5923-cd6d-4271-8871-aa3d15f07040 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33192024-11-18T21:03:20.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de13b6e-df2e-4f55-ac79-714e7edd0827 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33202024-11-18T21:03:20.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de13b6e-df2e-4f55-ac79-714e7edd0827 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33212024-11-18T21:03:20.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0de13b6e-df2e-4f55-ac79-714e7edd0827 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33222024-11-18T21:03:20.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 4cbd4f26-15db-497c-ace2-b87af0d340c6 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
33232024-11-18T21:03:21.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8679700e-9899-44ae-88d4-2d8387ce93f7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33242024-11-18T21:03:21.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8679700e-9899-44ae-88d4-2d8387ce93f7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33252024-11-18T21:03:21.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8679700e-9899-44ae-88d4-2d8387ce93f7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33262024-11-18T21:03:22.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b69c09e5-4a88-44eb-a8e9-09049b11ff49 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33272024-11-18T21:03:22.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b69c09e5-4a88-44eb-a8e9-09049b11ff49 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33282024-11-18T21:03:22.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b69c09e5-4a88-44eb-a8e9-09049b11ff49 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33292024-11-18T21:03:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 577a224e-1971-4c48-8cff-ba041007b969 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33302024-11-18T21:03:23.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 577a224e-1971-4c48-8cff-ba041007b969 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33312024-11-18T21:03:23.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 577a224e-1971-4c48-8cff-ba041007b969 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33322024-11-18T21:03:24.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 178c46c1-3ada-4546-9617-ed4f1c55a803 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33332024-11-18T21:03:24.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 178c46c1-3ada-4546-9617-ed4f1c55a803 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33342024-11-18T21:03:24.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 178c46c1-3ada-4546-9617-ed4f1c55a803 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33352024-11-18T21:03:25.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2207601a-e68c-480b-a2c3-b34fe28e762d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33362024-11-18T21:03:25.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2207601a-e68c-480b-a2c3-b34fe28e762d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33372024-11-18T21:03:25.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2207601a-e68c-480b-a2c3-b34fe28e762d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33382024-11-18T21:03:25.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = ce8b97f2-5a87-47dc-a824-f66132d7f844 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
33392024-11-18T21:03:25.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = ce8b97f2-5a87-47dc-a824-f66132d7f844 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
33402024-11-18T21:03:25.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = ce8b97f2-5a87-47dc-a824-f66132d7f844 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
33412024-11-18T21:03:25.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = adbde426-fe68-43e1-86d0-b20106719400 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
33422024-11-18T21:03:25.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = adbde426-fe68-43e1-86d0-b20106719400 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
33432024-11-18T21:03:25.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = adbde426-fe68-43e1-86d0-b20106719400 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
33442024-11-18T21:03:26.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31ba0312-eae1-4b9a-9642-9bcdf06f5fe6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33452024-11-18T21:03:26.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31ba0312-eae1-4b9a-9642-9bcdf06f5fe6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33462024-11-18T21:03:26.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31ba0312-eae1-4b9a-9642-9bcdf06f5fe6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33472024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
33482024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
33492024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33502024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33512024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33522024-11-18T21:03:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33532024-11-18T21:03:26.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-11-18T21:03:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33552024-11-18T21:03:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33562024-11-18T21:03:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572024-11-18T21:03:26.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33582024-11-18T21:03:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33592024-11-18T21:03:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33602024-11-18T21:03:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
33612024-11-18T21:03:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33622024-11-18T21:03:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33632024-11-18T21:03:26.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
33642024-11-18T21:03:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.459165ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
33652024-11-18T21:03:26.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33662024-11-18T21:03:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33672024-11-18T21:03:26.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.795295ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33682024-11-18T21:03:27.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d86728d0-856f-46f8-bd57-337c3206cf3c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33692024-11-18T21:03:27.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d86728d0-856f-46f8-bd57-337c3206cf3c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33702024-11-18T21:03:27.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d86728d0-856f-46f8-bd57-337c3206cf3c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33712024-11-18T21:03:28.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09efce81-0eb5-4470-add3-c1b9c3e20784 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33722024-11-18T21:03:28.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09efce81-0eb5-4470-add3-c1b9c3e20784 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33732024-11-18T21:03:28.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09efce81-0eb5-4470-add3-c1b9c3e20784 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33742024-11-18T21:03:29.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 960cabb9-164a-4b87-bb25-4bc93b2a85a6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33752024-11-18T21:03:29.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 960cabb9-164a-4b87-bb25-4bc93b2a85a6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33762024-11-18T21:03:29.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 960cabb9-164a-4b87-bb25-4bc93b2a85a6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33772024-11-18T21:03:30.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9828e-87db-4ebf-ae0e-228a9789634f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33782024-11-18T21:03:30.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9828e-87db-4ebf-ae0e-228a9789634f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33792024-11-18T21:03:30.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9828e-87db-4ebf-ae0e-228a9789634f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33802024-11-18T21:03:31.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68b7d82b-1f80-4a9f-870e-64092f5b7cee roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33812024-11-18T21:03:31.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68b7d82b-1f80-4a9f-870e-64092f5b7cee resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33822024-11-18T21:03:31.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68b7d82b-1f80-4a9f-870e-64092f5b7cee response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33832024-11-18T21:03:32.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b319327-88a8-4baf-8808-65b3d99f0d75 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33842024-11-18T21:03:32.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b319327-88a8-4baf-8808-65b3d99f0d75 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33852024-11-18T21:03:32.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b319327-88a8-4baf-8808-65b3d99f0d75 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33862024-11-18T21:03:33.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a14639d-d7a8-4436-ab0b-a6ab0709b717 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33872024-11-18T21:03:33.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a14639d-d7a8-4436-ab0b-a6ab0709b717 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33882024-11-18T21:03:33.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a14639d-d7a8-4436-ab0b-a6ab0709b717 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33892024-11-18T21:03:34.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6665078b-c3e8-4ee2-a22c-f11aa4c0d467 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33902024-11-18T21:03:34.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6665078b-c3e8-4ee2-a22c-f11aa4c0d467 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33912024-11-18T21:03:34.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6665078b-c3e8-4ee2-a22c-f11aa4c0d467 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33922024-11-18T21:03:35.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e64dc226-1980-47a0-8ff1-7c487eaad67b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33932024-11-18T21:03:35.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e64dc226-1980-47a0-8ff1-7c487eaad67b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33942024-11-18T21:03:35.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e64dc226-1980-47a0-8ff1-7c487eaad67b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
33952024-11-18T21:03:35.870ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = bbb60822-9ab3-48b7-ae4e-02c5a8beed44 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
33962024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
33972024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
33982024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33992024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34002024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
34012024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
34022024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34032024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34042024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
34052024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
34062024-11-18T21:03:36.237ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34072024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34082024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
34092024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34102024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34112024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34122024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
34132024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34142024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
34152024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34162024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
34172024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34182024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
34192024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34202024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
34212024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
34222024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34232024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
34242024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
34252024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34262024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34272024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
34282024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
34292024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34302024-11-18T21:03:36.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34322024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34332024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34342024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34352024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34362024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34372024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34382024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34392024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34402024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34412024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34422024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34442024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34452024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34462024-11-18T21:03:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34472024-11-18T21:03:36.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 557484863 } })
34482024-11-18T21:03:36.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
34492024-11-18T21:03:36.241ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.662728ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34502024-11-18T21:03:36.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 558184288 } })
34512024-11-18T21:03:36.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
34522024-11-18T21:03:36.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532024-11-18T21:03:36.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542024-11-18T21:03:36.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34552024-11-18T21:03:36.243ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34562024-11-18T21:03:36.243ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34572024-11-18T21:03:36.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34582024-11-18T21:03:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34592024-11-18T21:03:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34602024-11-18T21:03:36.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34612024-11-18T21:03:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34622024-11-18T21:03:36.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34632024-11-18T21:03:36.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34642024-11-18T21:03:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34652024-11-18T21:03:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34662024-11-18T21:03:36.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34672024-11-18T21:03:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34682024-11-18T21:03:36.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692024-11-18T21:03:36.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-11-18T21:03:36.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34722024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34732024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34742024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34752024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34762024-11-18T21:03:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34772024-11-18T21:03:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34782024-11-18T21:03:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34792024-11-18T21:03:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802024-11-18T21:03:36.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812024-11-18T21:03:36.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34822024-11-18T21:03:36.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34832024-11-18T21:03:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34842024-11-18T21:03:36.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34852024-11-18T21:03:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34862024-11-18T21:03:36.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34872024-11-18T21:03:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34882024-11-18T21:03:36.264ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 580778987 } })
34892024-11-18T21:03:36.264ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
34902024-11-18T21:03:36.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34912024-11-18T21:03:36.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34922024-11-18T21:03:36.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34932024-11-18T21:03:36.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34942024-11-18T21:03:36.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952024-11-18T21:03:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
34962024-11-18T21:03:36.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972024-11-18T21:03:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982024-11-18T21:03:36.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34992024-11-18T21:03:36.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35002024-11-18T21:03:36.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012024-11-18T21:03:36.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.258118ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
35022024-11-18T21:03:36.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35032024-11-18T21:03:36.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35042024-11-18T21:03:36.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35052024-11-18T21:03:36.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35072024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35082024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35092024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35102024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35112024-11-18T21:03:36.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.690226ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
35122024-11-18T21:03:36.284ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35132024-11-18T21:03:36.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35142024-11-18T21:03:36.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.460721ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35152024-11-18T21:03:36.287ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
35162024-11-18T21:03:36.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.63529ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
35172024-11-18T21:03:36.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35182024-11-18T21:03:36.290ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35192024-11-18T21:03:36.290ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35202024-11-18T21:03:36.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35212024-11-18T21:03:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35222024-11-18T21:03:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35232024-11-18T21:03:36.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35242024-11-18T21:03:36.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35252024-11-18T21:03:36.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35262024-11-18T21:03:36.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35272024-11-18T21:03:36.309ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35282024-11-18T21:03:36.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.161629ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35292024-11-18T21:03:36.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35302024-11-18T21:03:36.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35312024-11-18T21:03:36.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.1554ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35322024-11-18T21:03:36.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35332024-11-18T21:03:36.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35342024-11-18T21:03:36.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35352024-11-18T21:03:36.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35362024-11-18T21:03:36.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35372024-11-18T21:03:36.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35382024-11-18T21:03:36.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.364092ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35392024-11-18T21:03:36.328ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35402024-11-18T21:03:36.328ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35412024-11-18T21:03:36.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.371734ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35422024-11-18T21:03:36.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35432024-11-18T21:03:36.331ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35442024-11-18T21:03:36.331ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "031521f8-f542-4585-8bc3-4166bfefa9f5", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
35452024-11-18T21:03:36.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35462024-11-18T21:03:36.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35472024-11-18T21:03:36.333ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35482024-11-18T21:03:36.333ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35492024-11-18T21:03:36.334ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d60ba36-cff8-4bea-995d-7b213e98d8c3", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
35502024-11-18T21:03:36.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35512024-11-18T21:03:36.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35522024-11-18T21:03:36.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.00826ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35532024-11-18T21:03:36.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35542024-11-18T21:03:36.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
35552024-11-18T21:03:36.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35562024-11-18T21:03:36.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35572024-11-18T21:03:36.347ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.349076ms iteration = 6 status = 0
35582024-11-18T21:03:36.354ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.901752ms iteration = 8 status = {"physical_disks_added":0}
35592024-11-18T21:03:36.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad7477b-70df-4d78-9179-c3beb53100e2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
35602024-11-18T21:03:36.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad7477b-70df-4d78-9179-c3beb53100e2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
35612024-11-18T21:03:36.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad7477b-70df-4d78-9179-c3beb53100e2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
35622024-11-18T21:03:36.381ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
35632024-11-18T21:03:36.381ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35642024-11-18T21:03:36.381ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ed16d96-3bda-4899-b2bd-197080ee401f", "content-length": "26", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
35652024-11-18T21:03:36.381ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35662024-11-18T21:03:36.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
35672024-11-18T21:03:36.439ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35682024-11-18T21:03:36.439ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7122987b-51c2-44d8-a76a-1cff9b95f6e7", "content-length": "1", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
35692024-11-18T21:03:36.441ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35702024-11-18T21:03:36.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35712024-11-18T21:03:36.443ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.607463ms iteration = 6 status = null
35722024-11-18T21:03:36.489ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 252.12138ms iteration = 6 status = {}
35732024-11-18T21:03:36.558ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35742024-11-18T21:03:36.558ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35752024-11-18T21:03:36.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "60807f5a-719d-4d13-b262-0ce0f4277eaa", "content-length": "372", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
35762024-11-18T21:03:36.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35772024-11-18T21:03:36.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35782024-11-18T21:03:36.575ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35792024-11-18T21:03:36.575ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dee357f5-0bb4-49ea-bcc3-f59a62f777c9", "content-length": "691", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
35802024-11-18T21:03:36.576ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35812024-11-18T21:03:36.576ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35822024-11-18T21:03:36.576ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35832024-11-18T21:03:36.577ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.27543ms iteration = 6 status = {}
35842024-11-18T21:03:36.601ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35852024-11-18T21:03:36.601ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35862024-11-18T21:03:36.601ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c362d70a-8dda-43bf-a058-81b9f85746b9", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
35872024-11-18T21:03:36.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35882024-11-18T21:03:36.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35892024-11-18T21:03:36.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35902024-11-18T21:03:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35912024-11-18T21:03:36.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35922024-11-18T21:03:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35932024-11-18T21:03:36.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35942024-11-18T21:03:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35952024-11-18T21:03:36.610ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35962024-11-18T21:03:36.610ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35972024-11-18T21:03:36.611ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a34c1352-8382-4d39-859e-a31e3057b4b1", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
35982024-11-18T21:03:36.612ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
35992024-11-18T21:03:36.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36002024-11-18T21:03:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36012024-11-18T21:03:36.612ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.997736ms iteration = 6 status = {}
36022024-11-18T21:03:36.619ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36032024-11-18T21:03:36.619ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "413d2204-65a9-4be7-ad82-f9d3cf8b92b7", "content-length": "134", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
36042024-11-18T21:03:36.619ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36052024-11-18T21:03:36.619ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
36062024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36072024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36082024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36092024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36102024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36112024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36122024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36132024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36142024-11-18T21:03:36.620ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
36152024-11-18T21:03:36.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36162024-11-18T21:03:36.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36172024-11-18T21:03:36.622ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36182024-11-18T21:03:36.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "98b5cfae-7954-446c-a3f9-0f276bc74963", "content-length": "2", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
36192024-11-18T21:03:36.622ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36202024-11-18T21:03:36.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9917dd5f-c97d-432c-adbc-4ed9ccb0b57f", "content-length": "51", "date": "Mon, 18 Nov 2024 21:03:36 GMT"} })
36212024-11-18T21:03:36.622ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
36222024-11-18T21:03:36.622ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36232024-11-18T21:03:36.709ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "04eb17f1-5fd7-427f-acb8-55d54a9669a8", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
36242024-11-18T21:03:36.709ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
36252024-11-18T21:03:36.709ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36262024-11-18T21:03:36.709ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0959298-4b3c-4f7e-ad23-87b72298a7b2", "content-length": "682", "date": "Mon, 18 Nov 2024 21:03:35 GMT"} })
36272024-11-18T21:03:36.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36282024-11-18T21:03:36.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36292024-11-18T21:03:36.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36302024-11-18T21:03:36.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36312024-11-18T21:03:36.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36322024-11-18T21:03:36.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36332024-11-18T21:03:36.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36342024-11-18T21:03:36.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36352024-11-18T21:03:36.723ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.503551ms iteration = 6 status = {}
36362024-11-18T21:03:37.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4011ca65-7d3a-4038-aff2-a054928ef865 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36372024-11-18T21:03:37.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4011ca65-7d3a-4038-aff2-a054928ef865 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36382024-11-18T21:03:37.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4011ca65-7d3a-4038-aff2-a054928ef865 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36392024-11-18T21:03:38.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c5a135c-2813-4182-b5c4-5c970bbbfbee roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36402024-11-18T21:03:38.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c5a135c-2813-4182-b5c4-5c970bbbfbee resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36412024-11-18T21:03:38.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c5a135c-2813-4182-b5c4-5c970bbbfbee response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36422024-11-18T21:03:39.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55326715-013d-49e0-83f3-e6d5c4a3bc90 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36432024-11-18T21:03:39.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55326715-013d-49e0-83f3-e6d5c4a3bc90 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36442024-11-18T21:03:39.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55326715-013d-49e0-83f3-e6d5c4a3bc90 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36452024-11-18T21:03:40.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ee14e60-3317-49fd-8a6f-ba5bbb37c0ce roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36462024-11-18T21:03:40.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ee14e60-3317-49fd-8a6f-ba5bbb37c0ce resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36472024-11-18T21:03:40.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ee14e60-3317-49fd-8a6f-ba5bbb37c0ce response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36482024-11-18T21:03:40.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c90b594f-b798-4de3-ab96-b55a21c3bdad roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
36492024-11-18T21:03:40.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c90b594f-b798-4de3-ab96-b55a21c3bdad resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
36502024-11-18T21:03:40.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c90b594f-b798-4de3-ab96-b55a21c3bdad response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
36512024-11-18T21:03:40.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 729d53df-710e-49db-a68c-16fff159bdcb roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
36522024-11-18T21:03:40.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 729d53df-710e-49db-a68c-16fff159bdcb resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
36532024-11-18T21:03:40.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 729d53df-710e-49db-a68c-16fff159bdcb response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
36542024-11-18T21:03:41.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0f75a02-7ccf-4442-bc93-5ef037bac7c9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36552024-11-18T21:03:41.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0f75a02-7ccf-4442-bc93-5ef037bac7c9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36562024-11-18T21:03:41.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0f75a02-7ccf-4442-bc93-5ef037bac7c9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36572024-11-18T21:03:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41913105-cb72-436a-8b69-73bcc67db3f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36582024-11-18T21:03:42.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41913105-cb72-436a-8b69-73bcc67db3f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36592024-11-18T21:03:42.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41913105-cb72-436a-8b69-73bcc67db3f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36602024-11-18T21:03:43.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efb57de6-e514-4591-8493-19ef5e4f565f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36612024-11-18T21:03:43.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efb57de6-e514-4591-8493-19ef5e4f565f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36622024-11-18T21:03:43.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efb57de6-e514-4591-8493-19ef5e4f565f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36632024-11-18T21:03:44.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5cc96ee9-caec-4d92-ab52-4302277cd698 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36642024-11-18T21:03:44.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5cc96ee9-caec-4d92-ab52-4302277cd698 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36652024-11-18T21:03:44.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5cc96ee9-caec-4d92-ab52-4302277cd698 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36662024-11-18T21:03:45.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c61ec41d-754b-4e06-b911-1c1205f5e825 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36672024-11-18T21:03:45.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c61ec41d-754b-4e06-b911-1c1205f5e825 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36682024-11-18T21:03:45.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c61ec41d-754b-4e06-b911-1c1205f5e825 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36692024-11-18T21:03:46.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
36702024-11-18T21:03:46.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
36712024-11-18T21:03:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36722024-11-18T21:03:46.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36732024-11-18T21:03:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36742024-11-18T21:03:46.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36752024-11-18T21:03:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36762024-11-18T21:03:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36772024-11-18T21:03:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782024-11-18T21:03:46.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.592687ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36792024-11-18T21:03:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36802024-11-18T21:03:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36812024-11-18T21:03:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36822024-11-18T21:03:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36832024-11-18T21:03:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36842024-11-18T21:03:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36852024-11-18T21:03:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
36862024-11-18T21:03:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36872024-11-18T21:03:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36882024-11-18T21:03:46.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
36892024-11-18T21:03:46.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.117963ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
36902024-11-18T21:03:46.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05cbbe22-ed11-48c1-85b7-dd3f9db2efb2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36912024-11-18T21:03:46.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05cbbe22-ed11-48c1-85b7-dd3f9db2efb2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36922024-11-18T21:03:46.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05cbbe22-ed11-48c1-85b7-dd3f9db2efb2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36932024-11-18T21:03:47.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85103944-05bd-4315-9361-17643fff4a1f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36942024-11-18T21:03:47.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85103944-05bd-4315-9361-17643fff4a1f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36952024-11-18T21:03:47.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85103944-05bd-4315-9361-17643fff4a1f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36962024-11-18T21:03:48.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f82174-fdb5-4628-b715-86a06dd47abe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36972024-11-18T21:03:48.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f82174-fdb5-4628-b715-86a06dd47abe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36982024-11-18T21:03:48.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f82174-fdb5-4628-b715-86a06dd47abe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
36992024-11-18T21:03:49.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0349b44b-1e12-4dd6-806a-67375621b455 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37002024-11-18T21:03:49.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0349b44b-1e12-4dd6-806a-67375621b455 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37012024-11-18T21:03:49.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0349b44b-1e12-4dd6-806a-67375621b455 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37022024-11-18T21:03:50.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f7b1c46-bb2f-4bb5-9322-9152ad807268 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37032024-11-18T21:03:50.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f7b1c46-bb2f-4bb5-9322-9152ad807268 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37042024-11-18T21:03:50.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f7b1c46-bb2f-4bb5-9322-9152ad807268 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37052024-11-18T21:03:50.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 720 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = cf378b60-8078-45e7-ba18-de0b74823d10 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
37062024-11-18T21:03:51.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a0a3cdd-5b0d-42e9-8616-58ead4f9434f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37072024-11-18T21:03:51.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a0a3cdd-5b0d-42e9-8616-58ead4f9434f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37082024-11-18T21:03:51.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a0a3cdd-5b0d-42e9-8616-58ead4f9434f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37092024-11-18T21:03:52.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd7c061f-45dd-4a66-a587-537bc85925ef roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37102024-11-18T21:03:52.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd7c061f-45dd-4a66-a587-537bc85925ef resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37112024-11-18T21:03:52.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd7c061f-45dd-4a66-a587-537bc85925ef response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37122024-11-18T21:03:53.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df3966bb-1956-4743-819e-6e38cc5c3bc0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37132024-11-18T21:03:53.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df3966bb-1956-4743-819e-6e38cc5c3bc0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37142024-11-18T21:03:53.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df3966bb-1956-4743-819e-6e38cc5c3bc0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37152024-11-18T21:03:54.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 499700a6-be2e-49bd-9c02-e1e9cc7f542b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37162024-11-18T21:03:54.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 499700a6-be2e-49bd-9c02-e1e9cc7f542b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37172024-11-18T21:03:54.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 499700a6-be2e-49bd-9c02-e1e9cc7f542b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37182024-11-18T21:03:55.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f37806-ad3c-4135-840b-03594fe076bb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37192024-11-18T21:03:55.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f37806-ad3c-4135-840b-03594fe076bb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37202024-11-18T21:03:55.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f37806-ad3c-4135-840b-03594fe076bb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37212024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
37222024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
37232024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37242024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37252024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37262024-11-18T21:03:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272024-11-18T21:03:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37282024-11-18T21:03:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37292024-11-18T21:03:56.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37302024-11-18T21:03:56.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.071711ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37312024-11-18T21:03:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37322024-11-18T21:03:56.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37332024-11-18T21:03:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37342024-11-18T21:03:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37352024-11-18T21:03:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37362024-11-18T21:03:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372024-11-18T21:03:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
37382024-11-18T21:03:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37392024-11-18T21:03:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37402024-11-18T21:03:56.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
37412024-11-18T21:03:56.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.321042ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
37422024-11-18T21:03:56.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13135e-2cff-46b4-9bf1-c180596fe89e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37432024-11-18T21:03:56.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13135e-2cff-46b4-9bf1-c180596fe89e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37442024-11-18T21:03:56.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13135e-2cff-46b4-9bf1-c180596fe89e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37452024-11-18T21:03:57.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c2e53ed-347c-4918-9d4f-d29cc330a438 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37462024-11-18T21:03:57.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c2e53ed-347c-4918-9d4f-d29cc330a438 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37472024-11-18T21:03:57.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c2e53ed-347c-4918-9d4f-d29cc330a438 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37482024-11-18T21:03:58.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6747eed8-1e0a-41d7-a0fb-307e63c0c7a0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37492024-11-18T21:03:58.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6747eed8-1e0a-41d7-a0fb-307e63c0c7a0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37502024-11-18T21:03:58.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6747eed8-1e0a-41d7-a0fb-307e63c0c7a0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37512024-11-18T21:03:59.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9938ec8c-b44f-4506-8d60-1f52d2eae0b5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37522024-11-18T21:03:59.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9938ec8c-b44f-4506-8d60-1f52d2eae0b5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37532024-11-18T21:03:59.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9938ec8c-b44f-4506-8d60-1f52d2eae0b5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37542024-11-18T21:04:00.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54b05fce-6707-4c94-a563-318d9572cb01 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37552024-11-18T21:04:00.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54b05fce-6707-4c94-a563-318d9572cb01 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37562024-11-18T21:04:00.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54b05fce-6707-4c94-a563-318d9572cb01 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37572024-11-18T21:04:02.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d05ff9a4-3d11-441f-aa64-5828c3ef4d7a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37582024-11-18T21:04:02.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d05ff9a4-3d11-441f-aa64-5828c3ef4d7a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37592024-11-18T21:04:02.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d05ff9a4-3d11-441f-aa64-5828c3ef4d7a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37602024-11-18T21:04:03.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08884968-95b2-4fea-8862-fd34fb71eb82 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37612024-11-18T21:04:03.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08884968-95b2-4fea-8862-fd34fb71eb82 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37622024-11-18T21:04:03.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08884968-95b2-4fea-8862-fd34fb71eb82 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37632024-11-18T21:04:04.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2edea4f-2007-48d4-84a2-3e95ed30ab45 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37642024-11-18T21:04:04.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2edea4f-2007-48d4-84a2-3e95ed30ab45 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37652024-11-18T21:04:04.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2edea4f-2007-48d4-84a2-3e95ed30ab45 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37662024-11-18T21:04:05.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ffc391b8-9d13-4fca-a29d-8183a3f22a7f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37672024-11-18T21:04:05.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ffc391b8-9d13-4fca-a29d-8183a3f22a7f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37682024-11-18T21:04:05.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ffc391b8-9d13-4fca-a29d-8183a3f22a7f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37692024-11-18T21:04:05.871ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = afdb322b-5c41-4bb6-b7dd-a57992800b88 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
37702024-11-18T21:04:06.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d059afb-2990-4fb8-85af-1867aedaed1e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37712024-11-18T21:04:06.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d059afb-2990-4fb8-85af-1867aedaed1e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37722024-11-18T21:04:06.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d059afb-2990-4fb8-85af-1867aedaed1e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
37732024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
37742024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
37752024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37762024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
37772024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37782024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
37792024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
37802024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
37812024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37822024-11-18T21:04:06.237ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:54:06.237928342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
37832024-11-18T21:04:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
37842024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
37852024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37862024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37872024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
37882024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
37892024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37902024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37912024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
37922024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
37932024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37942024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
37952024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37962024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
37972024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
37982024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37992024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
38002024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38012024-11-18T21:04:06.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38022024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
38032024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38042024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38052024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38062024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
38072024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
38082024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38092024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38102024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
38112024-11-18T21:04:06.238ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
38122024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
38132024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.281\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
38142024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38152024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
38162024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38172024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
38182024-11-18T21:04:06.238ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38192024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38202024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
38212024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
38222024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38232024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
38242024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
38252024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38262024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38272024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
38282024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38292024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38302024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
38312024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
38322024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38332024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38342024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38352024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
38362024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
38372024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38382024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38392024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38402024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38412024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38422024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38432024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38442024-11-18T21:04:06.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 554605491 } })
38452024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38462024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38472024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38482024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38492024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38502024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38512024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38522024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38532024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38542024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38552024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38562024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38572024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38582024-11-18T21:04:06.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 554862093 } })
38592024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38602024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38612024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38622024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38632024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38642024-11-18T21:04:06.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38652024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
38662024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.234509ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
38672024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38682024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38692024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38702024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38712024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
38722024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.472611ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
38732024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38742024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38752024-11-18T21:04:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38762024-11-18T21:04:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38772024-11-18T21:04:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38782024-11-18T21:04:06.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-11-18T21:04:06.245ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:54:06.237928342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38802024-11-18T21:04:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.0418ms iteration = 4 status = {"expiration":"2024-11-18T20:54:06.237928342Z","pruned":[]}
38812024-11-18T21:04:06.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38822024-11-18T21:04:06.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38832024-11-18T21:04:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38842024-11-18T21:04:06.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 566409149 } })
38852024-11-18T21:04:06.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 566543030 } })
38862024-11-18T21:04:06.250ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.433993ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38872024-11-18T21:04:06.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
38882024-11-18T21:04:06.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
38892024-11-18T21:04:06.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38902024-11-18T21:04:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38912024-11-18T21:04:06.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922024-11-18T21:04:06.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932024-11-18T21:04:06.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38952024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38962024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38972024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38982024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38992024-11-18T21:04:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39002024-11-18T21:04:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39012024-11-18T21:04:06.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39022024-11-18T21:04:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39032024-11-18T21:04:06.258ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39042024-11-18T21:04:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39052024-11-18T21:04:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.513951ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
39062024-11-18T21:04:06.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-11-18T21:04:06.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082024-11-18T21:04:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39092024-11-18T21:04:06.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102024-11-18T21:04:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-11-18T21:04:06.264ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39122024-11-18T21:04:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39132024-11-18T21:04:06.265ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.270513ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
39142024-11-18T21:04:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39152024-11-18T21:04:06.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39162024-11-18T21:04:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39172024-11-18T21:04:06.266ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39182024-11-18T21:04:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39192024-11-18T21:04:06.269ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39202024-11-18T21:04:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39212024-11-18T21:04:06.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39222024-11-18T21:04:06.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39232024-11-18T21:04:06.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39242024-11-18T21:04:06.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39252024-11-18T21:04:06.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262024-11-18T21:04:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39272024-11-18T21:04:06.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39282024-11-18T21:04:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39292024-11-18T21:04:06.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39302024-11-18T21:04:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39312024-11-18T21:04:06.279ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39322024-11-18T21:04:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39332024-11-18T21:04:06.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39342024-11-18T21:04:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39352024-11-18T21:04:06.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39362024-11-18T21:04:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39372024-11-18T21:04:06.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39382024-11-18T21:04:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39392024-11-18T21:04:06.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402024-11-18T21:04:06.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39412024-11-18T21:04:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39422024-11-18T21:04:06.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39432024-11-18T21:04:06.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39442024-11-18T21:04:06.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39452024-11-18T21:04:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39462024-11-18T21:04:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39472024-11-18T21:04:06.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39482024-11-18T21:04:06.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.343373ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39492024-11-18T21:04:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39502024-11-18T21:04:06.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39512024-11-18T21:04:06.294ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39522024-11-18T21:04:06.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.38014ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39532024-11-18T21:04:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39542024-11-18T21:04:06.296ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39552024-11-18T21:04:06.296ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39562024-11-18T21:04:06.296ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 58.492416ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39572024-11-18T21:04:06.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-11-18T21:04:06.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39592024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39612024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39632024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39642024-11-18T21:04:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39652024-11-18T21:04:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39662024-11-18T21:04:06.306ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39672024-11-18T21:04:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39682024-11-18T21:04:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39692024-11-18T21:04:06.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39702024-11-18T21:04:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39712024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
39722024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39732024-11-18T21:04:06.310ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39742024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39752024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39762024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39772024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39782024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39792024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39802024-11-18T21:04:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39812024-11-18T21:04:06.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.221556ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
39822024-11-18T21:04:06.317ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39832024-11-18T21:04:06.317ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39842024-11-18T21:04:06.317ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.804048ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39852024-11-18T21:04:06.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-18T21:04:06.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872024-11-18T21:04:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39882024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39892024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39902024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39912024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39922024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39932024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39942024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39952024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39962024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39972024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39982024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39992024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40002024-11-18T21:04:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40012024-11-18T21:04:06.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.384654ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40022024-11-18T21:04:06.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40032024-11-18T21:04:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40042024-11-18T21:04:06.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40052024-11-18T21:04:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40062024-11-18T21:04:06.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40072024-11-18T21:04:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40082024-11-18T21:04:06.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40092024-11-18T21:04:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40102024-11-18T21:04:06.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.216245ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40112024-11-18T21:04:06.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40122024-11-18T21:04:06.368ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40132024-11-18T21:04:06.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
40142024-11-18T21:04:06.370ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40152024-11-18T21:04:06.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
40162024-11-18T21:04:06.371ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40172024-11-18T21:04:06.371ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd73496-762a-4446-a043-ac6c374dcd6a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
40182024-11-18T21:04:06.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40192024-11-18T21:04:06.371ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a45d58a4-3ae2-44cc-b855-139b5c0dad49", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
40202024-11-18T21:04:06.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40212024-11-18T21:04:06.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40222024-11-18T21:04:06.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40232024-11-18T21:04:06.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40242024-11-18T21:04:06.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40252024-11-18T21:04:06.452ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40262024-11-18T21:04:06.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40272024-11-18T21:04:06.453ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e99267-3a31-46ad-9dfd-8e9e0740e252", "content-length": "372", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
40282024-11-18T21:04:06.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40292024-11-18T21:04:06.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40302024-11-18T21:04:06.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40312024-11-18T21:04:06.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 772816419 } })
40322024-11-18T21:04:06.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
40332024-11-18T21:04:06.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-11-18T21:04:06.457ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 218.949862ms iteration = 3 status = {"nsuccess":5}
40352024-11-18T21:04:06.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40362024-11-18T21:04:06.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40372024-11-18T21:04:06.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40382024-11-18T21:04:06.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40392024-11-18T21:04:06.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40402024-11-18T21:04:06.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40412024-11-18T21:04:06.461ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40422024-11-18T21:04:06.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40432024-11-18T21:04:06.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-11-18T21:04:06.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40452024-11-18T21:04:06.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40462024-11-18T21:04:06.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40472024-11-18T21:04:06.465ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
40482024-11-18T21:04:06.465ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 227.780479ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
40492024-11-18T21:04:06.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502024-11-18T21:04:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
40512024-11-18T21:04:06.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40522024-11-18T21:04:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40532024-11-18T21:04:06.480ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 241.683752ms iteration = 7 status = 0
40542024-11-18T21:04:06.501ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40552024-11-18T21:04:06.501ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40562024-11-18T21:04:06.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40572024-11-18T21:04:06.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40582024-11-18T21:04:06.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 265.854852ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40592024-11-18T21:04:06.504ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.095045ms iteration = 9 status = {"physical_disks_added":0}
40602024-11-18T21:04:06.509ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40612024-11-18T21:04:06.509ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
40622024-11-18T21:04:06.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40632024-11-18T21:04:06.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40642024-11-18T21:04:06.513ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40652024-11-18T21:04:06.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40662024-11-18T21:04:06.514ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ce1d022-1b81-4598-ab3e-e538b056d220", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
40672024-11-18T21:04:06.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40682024-11-18T21:04:06.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40692024-11-18T21:04:06.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40702024-11-18T21:04:06.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40712024-11-18T21:04:06.520ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40722024-11-18T21:04:06.520ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40732024-11-18T21:04:06.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40742024-11-18T21:04:06.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40752024-11-18T21:04:06.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40762024-11-18T21:04:06.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40772024-11-18T21:04:06.521ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40782024-11-18T21:04:06.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40792024-11-18T21:04:06.524ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40802024-11-18T21:04:06.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40812024-11-18T21:04:06.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2e249f29-4c92-4786-8e77-3cd9a0a590e2", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
40822024-11-18T21:04:06.525ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.574425ms iteration = 7 status = {}
40832024-11-18T21:04:06.526ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40842024-11-18T21:04:06.526ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b88cf49-9bc7-4c1d-bb81-f7e3ce7ca63b", "content-length": "1", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} })
40852024-11-18T21:04:06.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40862024-11-18T21:04:06.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40872024-11-18T21:04:06.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40882024-11-18T21:04:06.528ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40892024-11-18T21:04:06.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40902024-11-18T21:04:06.528ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
40912024-11-18T21:04:06.528ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 290.92426ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40922024-11-18T21:04:06.529ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40932024-11-18T21:04:06.529ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40942024-11-18T21:04:06.529ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
40952024-11-18T21:04:06.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 291.954037ms iteration = 4 status = {"generation":1}
40962024-11-18T21:04:06.530ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.931295ms iteration = 7 status = null
40972024-11-18T21:04:06.535ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40982024-11-18T21:04:06.535ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40992024-11-18T21:04:06.535ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 297.442368ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41002024-11-18T21:04:06.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41012024-11-18T21:04:06.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41022024-11-18T21:04:06.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41032024-11-18T21:04:06.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41042024-11-18T21:04:06.543ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
41052024-11-18T21:04:06.543ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41062024-11-18T21:04:06.543ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
41072024-11-18T21:04:06.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 305.913111ms iteration = 4 status = {"generation":2}
41082024-11-18T21:04:06.568ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41092024-11-18T21:04:06.568ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 330.063602ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41102024-11-18T21:04:06.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41112024-11-18T21:04:06.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41122024-11-18T21:04:06.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41132024-11-18T21:04:06.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41142024-11-18T21:04:06.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41152024-11-18T21:04:06.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41162024-11-18T21:04:06.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41172024-11-18T21:04:06.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41182024-11-18T21:04:06.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41192024-11-18T21:04:06.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41202024-11-18T21:04:06.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
41212024-11-18T21:04:06.605ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41222024-11-18T21:04:06.605ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e6735b8-6823-4134-ad93-2600be794f21", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
41232024-11-18T21:04:06.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41242024-11-18T21:04:06.607ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
41252024-11-18T21:04:06.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41262024-11-18T21:04:06.623ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f1048fe7-cb06-4039-9616-0deb40dd2733", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41272024-11-18T21:04:06.623ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41282024-11-18T21:04:06.625ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ec15ff5f-b02e-4a60-af24-77498811869b", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41292024-11-18T21:04:06.625ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41302024-11-18T21:04:06.626ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.378887ms iteration = 7 status = {}
41312024-11-18T21:04:06.627ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41322024-11-18T21:04:06.627ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 389.692347ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41332024-11-18T21:04:06.665ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41342024-11-18T21:04:06.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "32d6f435-ac04-4e95-b9c3-381cc21b251b", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41352024-11-18T21:04:06.666ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41362024-11-18T21:04:06.667ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5076a9cd-1bb1-4196-ac3e-6219bfbcf421", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41372024-11-18T21:04:06.667ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41382024-11-18T21:04:06.669ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5f42f3d6-4d6a-4224-8231-cc3e9ffe0f06", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41392024-11-18T21:04:06.669ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41402024-11-18T21:04:06.671ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41412024-11-18T21:04:06.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 433.273551ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41422024-11-18T21:04:06.709ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41432024-11-18T21:04:06.710ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f9bed4c-7ffa-4455-b4db-3de6a9c32c2c", "content-length": "691", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} })
41442024-11-18T21:04:06.710ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41452024-11-18T21:04:06.710ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41462024-11-18T21:04:06.710ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41472024-11-18T21:04:06.712ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.701973ms iteration = 7 status = {}
41482024-11-18T21:04:06.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41492024-11-18T21:04:06.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41502024-11-18T21:04:06.767ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
41512024-11-18T21:04:06.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41522024-11-18T21:04:06.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41532024-11-18T21:04:06.778ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41542024-11-18T21:04:06.778ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e89d273-6253-4070-82e4-beaea7c7db1e", "content-length": "134", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} })
41552024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41562024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
41572024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41582024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41592024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41602024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41612024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41622024-11-18T21:04:06.778ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41632024-11-18T21:04:06.779ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41642024-11-18T21:04:06.779ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41652024-11-18T21:04:06.779ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
41662024-11-18T21:04:06.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41672024-11-18T21:04:06.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41682024-11-18T21:04:06.781ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41692024-11-18T21:04:06.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "951b5f76-43aa-4022-ac41-53339872a7da", "content-length": "2", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} })
41702024-11-18T21:04:06.782ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41712024-11-18T21:04:06.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "409676c7-0f2a-417a-b8d5-a18de0da721b", "content-length": "51", "date": "Mon, 18 Nov 2024 21:04:05 GMT"} })
41722024-11-18T21:04:06.782ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
41732024-11-18T21:04:06.782ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41742024-11-18T21:04:06.866ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2bff2fd8-645e-4c98-aad4-64be6d9c85c3", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
41752024-11-18T21:04:06.866ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
41762024-11-18T21:04:06.866ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41772024-11-18T21:04:06.866ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "272e3c60-0d60-4ec0-9acb-8c508b0833e3", "content-length": "682", "date": "Mon, 18 Nov 2024 21:04:06 GMT"} })
41782024-11-18T21:04:06.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41792024-11-18T21:04:06.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41802024-11-18T21:04:06.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41812024-11-18T21:04:06.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41822024-11-18T21:04:06.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41832024-11-18T21:04:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41842024-11-18T21:04:06.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41852024-11-18T21:04:06.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41862024-11-18T21:04:06.883ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.442414ms iteration = 7 status = {}
41872024-11-18T21:04:07.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cdaaadc2-926b-4c15-b5c0-0732024326c2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41882024-11-18T21:04:07.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cdaaadc2-926b-4c15-b5c0-0732024326c2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41892024-11-18T21:04:07.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cdaaadc2-926b-4c15-b5c0-0732024326c2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41902024-11-18T21:04:08.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7424df1-4a6f-447d-9d72-bb5907eea00c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41912024-11-18T21:04:08.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7424df1-4a6f-447d-9d72-bb5907eea00c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41922024-11-18T21:04:08.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7424df1-4a6f-447d-9d72-bb5907eea00c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41932024-11-18T21:04:09.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7793eaa-e4ac-45c6-97a2-a165d834d3d0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41942024-11-18T21:04:09.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7793eaa-e4ac-45c6-97a2-a165d834d3d0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41952024-11-18T21:04:09.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b7793eaa-e4ac-45c6-97a2-a165d834d3d0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41962024-11-18T21:04:10.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9b7d8d5-0ee1-406c-99a3-ecc1dbcb805e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41972024-11-18T21:04:10.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9b7d8d5-0ee1-406c-99a3-ecc1dbcb805e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41982024-11-18T21:04:10.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9b7d8d5-0ee1-406c-99a3-ecc1dbcb805e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
41992024-11-18T21:04:10.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = a3300ac5-cd51-4b22-a989-4d3122608ec9 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
42002024-11-18T21:04:10.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = a3300ac5-cd51-4b22-a989-4d3122608ec9 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
42012024-11-18T21:04:10.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = a3300ac5-cd51-4b22-a989-4d3122608ec9 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
42022024-11-18T21:04:10.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 0f669464-c374-407f-8ede-515c606ba9cc roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
42032024-11-18T21:04:10.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 0f669464-c374-407f-8ede-515c606ba9cc resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
42042024-11-18T21:04:10.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 0f669464-c374-407f-8ede-515c606ba9cc response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
42052024-11-18T21:04:11.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a1274a8-97df-484e-bdc4-111644014198 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42062024-11-18T21:04:11.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a1274a8-97df-484e-bdc4-111644014198 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42072024-11-18T21:04:11.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a1274a8-97df-484e-bdc4-111644014198 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42082024-11-18T21:04:12.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61440f16-5e6e-48b7-a9b5-50a749c68a91 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42092024-11-18T21:04:12.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61440f16-5e6e-48b7-a9b5-50a749c68a91 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42102024-11-18T21:04:12.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61440f16-5e6e-48b7-a9b5-50a749c68a91 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42112024-11-18T21:04:13.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d06fe8b-a307-4e34-86b7-0825f7d8074a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42122024-11-18T21:04:13.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d06fe8b-a307-4e34-86b7-0825f7d8074a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42132024-11-18T21:04:13.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d06fe8b-a307-4e34-86b7-0825f7d8074a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42142024-11-18T21:04:14.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 23ebcd57-4036-49d1-bfe3-f76fcadd79f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42152024-11-18T21:04:14.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 23ebcd57-4036-49d1-bfe3-f76fcadd79f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42162024-11-18T21:04:14.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 23ebcd57-4036-49d1-bfe3-f76fcadd79f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42172024-11-18T21:04:15.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 59015553-9435-45f8-a552-577b566104c0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42182024-11-18T21:04:15.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 59015553-9435-45f8-a552-577b566104c0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42192024-11-18T21:04:15.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 59015553-9435-45f8-a552-577b566104c0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42202024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
42212024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42222024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
42232024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42242024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42252024-11-18T21:04:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42262024-11-18T21:04:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42272024-11-18T21:04:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282024-11-18T21:04:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42292024-11-18T21:04:16.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.127851ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42302024-11-18T21:04:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42312024-11-18T21:04:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322024-11-18T21:04:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332024-11-18T21:04:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42342024-11-18T21:04:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42352024-11-18T21:04:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362024-11-18T21:04:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
42372024-11-18T21:04:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42382024-11-18T21:04:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42392024-11-18T21:04:16.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
42402024-11-18T21:04:16.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.368214ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
42412024-11-18T21:04:16.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a99e76d2-5066-4f9c-9695-859b8b6ac3de roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42422024-11-18T21:04:16.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a99e76d2-5066-4f9c-9695-859b8b6ac3de resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42432024-11-18T21:04:16.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a99e76d2-5066-4f9c-9695-859b8b6ac3de response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42442024-11-18T21:04:17.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a60b15f-1453-4efc-8bb5-db1ba682d110 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42452024-11-18T21:04:17.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a60b15f-1453-4efc-8bb5-db1ba682d110 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42462024-11-18T21:04:17.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a60b15f-1453-4efc-8bb5-db1ba682d110 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42472024-11-18T21:04:18.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4708333a-e8a1-4765-8db8-24a0c4079b0d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42482024-11-18T21:04:18.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4708333a-e8a1-4765-8db8-24a0c4079b0d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42492024-11-18T21:04:18.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4708333a-e8a1-4765-8db8-24a0c4079b0d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42502024-11-18T21:04:19.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb8b91a3-be1e-4f39-bd4e-0ffa277738ea roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42512024-11-18T21:04:19.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb8b91a3-be1e-4f39-bd4e-0ffa277738ea resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42522024-11-18T21:04:19.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb8b91a3-be1e-4f39-bd4e-0ffa277738ea response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42532024-11-18T21:04:20.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55f0f522-603d-4bbf-bfa3-82d073008d1d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42542024-11-18T21:04:20.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55f0f522-603d-4bbf-bfa3-82d073008d1d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42552024-11-18T21:04:20.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55f0f522-603d-4bbf-bfa3-82d073008d1d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42562024-11-18T21:04:20.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = d0893c4f-2eb1-4775-a7c2-751d02b00554 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
42572024-11-18T21:04:21.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fe96bf50-2158-4569-b7be-53b0fdf1117a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42582024-11-18T21:04:21.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fe96bf50-2158-4569-b7be-53b0fdf1117a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42592024-11-18T21:04:21.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fe96bf50-2158-4569-b7be-53b0fdf1117a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42602024-11-18T21:04:22.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a88b32e-1a80-4f8a-9d40-ef0b271dd16c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42612024-11-18T21:04:22.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a88b32e-1a80-4f8a-9d40-ef0b271dd16c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42622024-11-18T21:04:22.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a88b32e-1a80-4f8a-9d40-ef0b271dd16c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42632024-11-18T21:04:23.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5160ccc-5611-47b4-990d-6196d9893184 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42642024-11-18T21:04:23.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5160ccc-5611-47b4-990d-6196d9893184 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42652024-11-18T21:04:23.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5160ccc-5611-47b4-990d-6196d9893184 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42662024-11-18T21:04:24.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9e104-543d-496a-a4b6-fa8ea54f7f64 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42672024-11-18T21:04:24.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9e104-543d-496a-a4b6-fa8ea54f7f64 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42682024-11-18T21:04:24.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0aa9e104-543d-496a-a4b6-fa8ea54f7f64 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42692024-11-18T21:04:25.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d6ee429-3983-4ea4-babc-53938a08dedb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42702024-11-18T21:04:25.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d6ee429-3983-4ea4-babc-53938a08dedb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42712024-11-18T21:04:25.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d6ee429-3983-4ea4-babc-53938a08dedb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42722024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
42732024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42742024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
42752024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42762024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42772024-11-18T21:04:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42782024-11-18T21:04:26.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42792024-11-18T21:04:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42802024-11-18T21:04:26.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42812024-11-18T21:04:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42822024-11-18T21:04:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42832024-11-18T21:04:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-11-18T21:04:26.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42852024-11-18T21:04:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
42862024-11-18T21:04:26.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42872024-11-18T21:04:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42882024-11-18T21:04:26.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
42892024-11-18T21:04:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.428655ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
42902024-11-18T21:04:26.271ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42912024-11-18T21:04:26.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42922024-11-18T21:04:26.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.246166ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42932024-11-18T21:04:26.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e9894a-7cf5-4e60-ac0f-646d2bd2d71e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42942024-11-18T21:04:26.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e9894a-7cf5-4e60-ac0f-646d2bd2d71e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42952024-11-18T21:04:26.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e9894a-7cf5-4e60-ac0f-646d2bd2d71e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42962024-11-18T21:04:27.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 20dabd8c-df52-4f18-890e-3dad319d1a18 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42972024-11-18T21:04:27.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 20dabd8c-df52-4f18-890e-3dad319d1a18 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42982024-11-18T21:04:27.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 20dabd8c-df52-4f18-890e-3dad319d1a18 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
42992024-11-18T21:04:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ab63521-eada-4336-a35d-3ab2958bf654 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43002024-11-18T21:04:28.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ab63521-eada-4336-a35d-3ab2958bf654 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43012024-11-18T21:04:28.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ab63521-eada-4336-a35d-3ab2958bf654 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43022024-11-18T21:04:29.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71db6bb-b701-4622-b800-acb39bf1eb70 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43032024-11-18T21:04:29.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71db6bb-b701-4622-b800-acb39bf1eb70 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43042024-11-18T21:04:29.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71db6bb-b701-4622-b800-acb39bf1eb70 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43052024-11-18T21:04:30.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c785a17f-8d59-4649-bd69-e2d0c84a940f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43062024-11-18T21:04:30.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c785a17f-8d59-4649-bd69-e2d0c84a940f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43072024-11-18T21:04:30.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c785a17f-8d59-4649-bd69-e2d0c84a940f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43082024-11-18T21:04:31.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5abb2d67-6d56-451e-a799-50ede0c51b2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43092024-11-18T21:04:31.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5abb2d67-6d56-451e-a799-50ede0c51b2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43102024-11-18T21:04:31.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5abb2d67-6d56-451e-a799-50ede0c51b2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43112024-11-18T21:04:32.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 480bd41d-3ae5-49d8-a11f-1c6dec84a73e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43122024-11-18T21:04:32.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 480bd41d-3ae5-49d8-a11f-1c6dec84a73e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43132024-11-18T21:04:32.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 480bd41d-3ae5-49d8-a11f-1c6dec84a73e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43142024-11-18T21:04:33.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37fe637e-9b2e-4c5a-a96c-dd30e7deb814 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43152024-11-18T21:04:33.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37fe637e-9b2e-4c5a-a96c-dd30e7deb814 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43162024-11-18T21:04:33.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37fe637e-9b2e-4c5a-a96c-dd30e7deb814 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43172024-11-18T21:04:34.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7074d694-1a23-4b66-90d0-8f9938f28bb2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43182024-11-18T21:04:34.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7074d694-1a23-4b66-90d0-8f9938f28bb2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43192024-11-18T21:04:34.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7074d694-1a23-4b66-90d0-8f9938f28bb2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43202024-11-18T21:04:35.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c2f191db-bb6f-4bac-85ca-2488563c3ffd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43212024-11-18T21:04:35.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c2f191db-bb6f-4bac-85ca-2488563c3ffd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43222024-11-18T21:04:35.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c2f191db-bb6f-4bac-85ca-2488563c3ffd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
43232024-11-18T21:04:35.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = dc960c12-0530-4bc4-b4ca-e0b9a05bb340 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
43242024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
43252024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43262024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
43272024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43282024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43292024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43302024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
43312024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
43322024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
43332024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43342024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43352024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43362024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43372024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
43382024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
43392024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43402024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43412024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
43422024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43432024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
43442024-11-18T21:04:36.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43452024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43462024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
43472024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43482024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
43492024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43502024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
43512024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
43522024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43532024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43542024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
43552024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
43562024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43572024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43582024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
43592024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
43602024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43612024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43622024-11-18T21:04:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43632024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43642024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43652024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43662024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43672024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43682024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43692024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43712024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43722024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43732024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43742024-11-18T21:04:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43752024-11-18T21:04:36.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 556530435 } })
43762024-11-18T21:04:36.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
43772024-11-18T21:04:36.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 557195671 } })
43782024-11-18T21:04:36.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
43792024-11-18T21:04:36.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802024-11-18T21:04:36.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.624925ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43812024-11-18T21:04:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43822024-11-18T21:04:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43832024-11-18T21:04:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43842024-11-18T21:04:36.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-11-18T21:04:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43862024-11-18T21:04:36.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43872024-11-18T21:04:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43882024-11-18T21:04:36.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43892024-11-18T21:04:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43902024-11-18T21:04:36.255ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 571455507 } })
43912024-11-18T21:04:36.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
43922024-11-18T21:04:36.282ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43932024-11-18T21:04:36.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43942024-11-18T21:04:36.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-11-18T21:04:36.288ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43962024-11-18T21:04:36.288ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43972024-11-18T21:04:36.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43982024-11-18T21:04:36.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43992024-11-18T21:04:36.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.657425ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
44002024-11-18T21:04:36.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44012024-11-18T21:04:36.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44022024-11-18T21:04:36.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44032024-11-18T21:04:36.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44042024-11-18T21:04:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44052024-11-18T21:04:36.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-11-18T21:04:36.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.98459ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44072024-11-18T21:04:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44082024-11-18T21:04:36.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44092024-11-18T21:04:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44102024-11-18T21:04:36.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44112024-11-18T21:04:36.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.603842ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
44122024-11-18T21:04:36.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44132024-11-18T21:04:36.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44142024-11-18T21:04:36.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44152024-11-18T21:04:36.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44162024-11-18T21:04:36.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44172024-11-18T21:04:36.298ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44182024-11-18T21:04:36.298ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.082418ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44192024-11-18T21:04:36.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44202024-11-18T21:04:36.299ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212024-11-18T21:04:36.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44222024-11-18T21:04:36.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44232024-11-18T21:04:36.299ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44242024-11-18T21:04:36.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44252024-11-18T21:04:36.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-11-18T21:04:36.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44272024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44282024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44292024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44302024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44312024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44322024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44332024-11-18T21:04:36.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44342024-11-18T21:04:36.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44352024-11-18T21:04:36.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44362024-11-18T21:04:36.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44372024-11-18T21:04:36.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44382024-11-18T21:04:36.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44392024-11-18T21:04:36.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44402024-11-18T21:04:36.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44412024-11-18T21:04:36.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44422024-11-18T21:04:36.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-11-18T21:04:36.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
44442024-11-18T21:04:36.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44452024-11-18T21:04:36.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44462024-11-18T21:04:36.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
44472024-11-18T21:04:36.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44482024-11-18T21:04:36.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44492024-11-18T21:04:36.312ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.183973ms iteration = 8 status = 0
44502024-11-18T21:04:36.322ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44512024-11-18T21:04:36.322ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44522024-11-18T21:04:36.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44532024-11-18T21:04:36.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44542024-11-18T21:04:36.323ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44552024-11-18T21:04:36.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44562024-11-18T21:04:36.323ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
44572024-11-18T21:04:36.323ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.842533ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
44582024-11-18T21:04:36.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.597013ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44592024-11-18T21:04:36.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44602024-11-18T21:04:36.332ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44612024-11-18T21:04:36.332ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a93bd8-2a9c-4ba8-82d7-86531cd46d85", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
44622024-11-18T21:04:36.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44632024-11-18T21:04:36.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.511112ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44642024-11-18T21:04:36.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44652024-11-18T21:04:36.358ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44662024-11-18T21:04:36.358ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44672024-11-18T21:04:36.358ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.872124ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44682024-11-18T21:04:36.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.101013ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44692024-11-18T21:04:36.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44702024-11-18T21:04:36.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44712024-11-18T21:04:36.405ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44722024-11-18T21:04:36.405ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44732024-11-18T21:04:36.405ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78d1f324-4ca7-4ec7-815c-34fec4696600", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
44742024-11-18T21:04:36.405ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44752024-11-18T21:04:36.407ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.375715ms iteration = 10 status = {"physical_disks_added":0}
44762024-11-18T21:04:36.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44772024-11-18T21:04:36.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
44782024-11-18T21:04:36.442ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44792024-11-18T21:04:36.442ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf73c66c-96de-46ff-91fe-ce83b4b9ee59", "content-length": "26", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
44802024-11-18T21:04:36.442ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44812024-11-18T21:04:36.442ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44822024-11-18T21:04:36.443ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8377a510-4e6b-41ec-89e4-40105762620b", "content-length": "1", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
44832024-11-18T21:04:36.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44842024-11-18T21:04:36.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44852024-11-18T21:04:36.445ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
44862024-11-18T21:04:36.511ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.173088ms iteration = 8 status = {}
44872024-11-18T21:04:36.513ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44882024-11-18T21:04:36.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44892024-11-18T21:04:36.515ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.886843ms iteration = 8 status = null
44902024-11-18T21:04:36.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44912024-11-18T21:04:36.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44922024-11-18T21:04:36.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-18T21:04:36.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44942024-11-18T21:04:36.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44952024-11-18T21:04:36.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44962024-11-18T21:04:36.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44972024-11-18T21:04:36.530ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44982024-11-18T21:04:36.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44992024-11-18T21:04:36.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45002024-11-18T21:04:36.562ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1010dbc-d676-4671-85e0-e9e4fcb6156d", "content-length": "372", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45012024-11-18T21:04:36.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45022024-11-18T21:04:36.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45032024-11-18T21:04:36.576ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45042024-11-18T21:04:36.576ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45052024-11-18T21:04:36.576ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8a9b68d3-bc7e-4380-a0bb-5b1cd0ba23f4", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45062024-11-18T21:04:36.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45072024-11-18T21:04:36.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45082024-11-18T21:04:36.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45092024-11-18T21:04:36.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45102024-11-18T21:04:36.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45112024-11-18T21:04:36.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45122024-11-18T21:04:36.585ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45132024-11-18T21:04:36.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45142024-11-18T21:04:36.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b4b3025-d38b-4f6e-90b1-fffe4cf8003e", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45152024-11-18T21:04:36.588ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 349.591188ms iteration = 8 status = {}
45162024-11-18T21:04:36.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45172024-11-18T21:04:36.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb5577c9-cfe1-4bb7-951c-17294fd2bd64", "content-length": "691", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45182024-11-18T21:04:36.656ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45192024-11-18T21:04:36.656ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45202024-11-18T21:04:36.656ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45212024-11-18T21:04:36.657ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.505151ms iteration = 8 status = {}
45222024-11-18T21:04:36.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45232024-11-18T21:04:36.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45242024-11-18T21:04:36.689ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
45252024-11-18T21:04:36.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45262024-11-18T21:04:36.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45272024-11-18T21:04:36.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45282024-11-18T21:04:36.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e34a732-4b9d-4b38-bb86-e5499620f058", "content-length": "134", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45292024-11-18T21:04:36.696ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45302024-11-18T21:04:36.696ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
45312024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45322024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45332024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45342024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45352024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45362024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45372024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45382024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45392024-11-18T21:04:36.697ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
45402024-11-18T21:04:36.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45412024-11-18T21:04:36.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45422024-11-18T21:04:36.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45432024-11-18T21:04:36.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e3e02f6-e876-4896-97e1-de34fd6ef8c0", "content-length": "2", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45442024-11-18T21:04:36.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45452024-11-18T21:04:36.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "064604e7-b64c-4080-a01f-cf578c664090", "content-length": "51", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45462024-11-18T21:04:36.699ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
45472024-11-18T21:04:36.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45482024-11-18T21:04:36.790ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c11bb76-3daa-4141-ab03-1022cb6afd71", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45492024-11-18T21:04:36.790ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
45502024-11-18T21:04:36.790ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45512024-11-18T21:04:36.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ff0dd15-70dc-4cb3-ab8a-457433c0dde0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45522024-11-18T21:04:36.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ff0dd15-70dc-4cb3-ab8a-457433c0dde0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45532024-11-18T21:04:36.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae6eb248-33bf-433b-86e0-4914106d8b48", "content-length": "682", "date": "Mon, 18 Nov 2024 21:04:36 GMT"} })
45542024-11-18T21:04:36.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45552024-11-18T21:04:36.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45562024-11-18T21:04:36.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ff0dd15-70dc-4cb3-ab8a-457433c0dde0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45572024-11-18T21:04:36.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45582024-11-18T21:04:36.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45592024-11-18T21:04:36.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45602024-11-18T21:04:36.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45612024-11-18T21:04:36.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45622024-11-18T21:04:36.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45632024-11-18T21:04:36.806ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 568.391889ms iteration = 8 status = {}
45642024-11-18T21:04:37.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e635068-754e-46bc-87e2-0ab478196522 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45652024-11-18T21:04:37.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e635068-754e-46bc-87e2-0ab478196522 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45662024-11-18T21:04:37.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e635068-754e-46bc-87e2-0ab478196522 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45672024-11-18T21:04:38.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a3548b1-9548-4e08-be62-a429ff90929e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45682024-11-18T21:04:38.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a3548b1-9548-4e08-be62-a429ff90929e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45692024-11-18T21:04:38.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a3548b1-9548-4e08-be62-a429ff90929e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45702024-11-18T21:04:39.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e024c99-8279-41dc-b14b-90d62d62183b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45712024-11-18T21:04:39.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e024c99-8279-41dc-b14b-90d62d62183b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45722024-11-18T21:04:39.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2e024c99-8279-41dc-b14b-90d62d62183b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45732024-11-18T21:04:40.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = b48a15b5-8ba5-44b7-86d2-4e958b384fba roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
45742024-11-18T21:04:40.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = b48a15b5-8ba5-44b7-86d2-4e958b384fba resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
45752024-11-18T21:04:40.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = b48a15b5-8ba5-44b7-86d2-4e958b384fba response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
45762024-11-18T21:04:40.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 46dccb5f-d91e-457a-9884-5546cb2f9e1c roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
45772024-11-18T21:04:40.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 46dccb5f-d91e-457a-9884-5546cb2f9e1c resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
45782024-11-18T21:04:40.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 46dccb5f-d91e-457a-9884-5546cb2f9e1c response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
45792024-11-18T21:04:40.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eeb3050-7a50-4252-a35c-c4d1600ba967 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45802024-11-18T21:04:40.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eeb3050-7a50-4252-a35c-c4d1600ba967 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45812024-11-18T21:04:40.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5eeb3050-7a50-4252-a35c-c4d1600ba967 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45822024-11-18T21:04:41.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e9e893d-db8d-4c82-a46c-809d54f9e7e8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45832024-11-18T21:04:41.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e9e893d-db8d-4c82-a46c-809d54f9e7e8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45842024-11-18T21:04:41.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e9e893d-db8d-4c82-a46c-809d54f9e7e8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45852024-11-18T21:04:42.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d656ef86-b0e4-4344-8cb8-b8f9ce010820 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45862024-11-18T21:04:42.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d656ef86-b0e4-4344-8cb8-b8f9ce010820 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45872024-11-18T21:04:42.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d656ef86-b0e4-4344-8cb8-b8f9ce010820 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45882024-11-18T21:04:43.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ed9319d-f540-4c25-b2bc-31ac5d20e4c1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45892024-11-18T21:04:43.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ed9319d-f540-4c25-b2bc-31ac5d20e4c1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45902024-11-18T21:04:43.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ed9319d-f540-4c25-b2bc-31ac5d20e4c1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45912024-11-18T21:04:44.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8318cfa-a880-4427-bdcd-83843a8d435c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45922024-11-18T21:04:44.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8318cfa-a880-4427-bdcd-83843a8d435c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45932024-11-18T21:04:44.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8318cfa-a880-4427-bdcd-83843a8d435c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45942024-11-18T21:04:45.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dae38cc-21e5-47db-aa98-04cae7e82548 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45952024-11-18T21:04:45.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dae38cc-21e5-47db-aa98-04cae7e82548 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45962024-11-18T21:04:45.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dae38cc-21e5-47db-aa98-04cae7e82548 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
45972024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
45982024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
45992024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46002024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46012024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46022024-11-18T21:04:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46032024-11-18T21:04:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042024-11-18T21:04:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46052024-11-18T21:04:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46062024-11-18T21:04:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46072024-11-18T21:04:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46082024-11-18T21:04:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46092024-11-18T21:04:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46102024-11-18T21:04:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46112024-11-18T21:04:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46122024-11-18T21:04:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
46132024-11-18T21:04:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46142024-11-18T21:04:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46152024-11-18T21:04:46.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
46162024-11-18T21:04:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.897628ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
46172024-11-18T21:04:46.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.397684ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46182024-11-18T21:04:47.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d485ba1-04e6-441b-ac17-07d3e575def2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46192024-11-18T21:04:47.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d485ba1-04e6-441b-ac17-07d3e575def2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46202024-11-18T21:04:47.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d485ba1-04e6-441b-ac17-07d3e575def2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46212024-11-18T21:04:48.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7a3da100-062a-4472-af72-8b65f62bd986 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46222024-11-18T21:04:48.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7a3da100-062a-4472-af72-8b65f62bd986 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46232024-11-18T21:04:48.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7a3da100-062a-4472-af72-8b65f62bd986 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46242024-11-18T21:04:49.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ec81088-3dda-4890-8602-aa10103e7f7c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46252024-11-18T21:04:49.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ec81088-3dda-4890-8602-aa10103e7f7c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46262024-11-18T21:04:49.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7ec81088-3dda-4890-8602-aa10103e7f7c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46272024-11-18T21:04:50.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f25cb332-8753-48c6-9957-0364669a797f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46282024-11-18T21:04:50.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f25cb332-8753-48c6-9957-0364669a797f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46292024-11-18T21:04:50.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f25cb332-8753-48c6-9957-0364669a797f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46302024-11-18T21:04:50.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 51526763-a4dd-4e35-a3bf-ecf9576d8b12 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
46312024-11-18T21:04:51.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11b8f8ef-887b-4cdf-b719-1ad377942310 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46322024-11-18T21:04:51.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11b8f8ef-887b-4cdf-b719-1ad377942310 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46332024-11-18T21:04:51.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11b8f8ef-887b-4cdf-b719-1ad377942310 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46342024-11-18T21:04:52.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c3ec5-ec2b-45c5-bfb6-c8e4a7989396 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46352024-11-18T21:04:52.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c3ec5-ec2b-45c5-bfb6-c8e4a7989396 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46362024-11-18T21:04:52.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c3ec5-ec2b-45c5-bfb6-c8e4a7989396 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46372024-11-18T21:04:53.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064f27f0-03d4-458a-92f9-7dac50afae1d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46382024-11-18T21:04:53.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064f27f0-03d4-458a-92f9-7dac50afae1d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46392024-11-18T21:04:53.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064f27f0-03d4-458a-92f9-7dac50afae1d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46402024-11-18T21:04:54.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c9484805-d565-4c74-9567-c8a2c1ff3bcc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46412024-11-18T21:04:54.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c9484805-d565-4c74-9567-c8a2c1ff3bcc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46422024-11-18T21:04:54.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c9484805-d565-4c74-9567-c8a2c1ff3bcc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46432024-11-18T21:04:55.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58edb003-3075-4b23-8a92-8ebafa39c98b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46442024-11-18T21:04:55.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58edb003-3075-4b23-8a92-8ebafa39c98b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46452024-11-18T21:04:55.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 58edb003-3075-4b23-8a92-8ebafa39c98b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46462024-11-18T21:04:56.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab202206-2675-4a5c-8994-62a492b0d09d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46472024-11-18T21:04:56.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab202206-2675-4a5c-8994-62a492b0d09d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46482024-11-18T21:04:56.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab202206-2675-4a5c-8994-62a492b0d09d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46492024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
46502024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
46512024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46522024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46532024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46542024-11-18T21:04:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46552024-11-18T21:04:56.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46562024-11-18T21:04:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46572024-11-18T21:04:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46582024-11-18T21:04:56.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.03564ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46592024-11-18T21:04:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46602024-11-18T21:04:56.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46612024-11-18T21:04:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46622024-11-18T21:04:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46632024-11-18T21:04:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46642024-11-18T21:04:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46652024-11-18T21:04:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
46662024-11-18T21:04:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46672024-11-18T21:04:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46682024-11-18T21:04:56.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
46692024-11-18T21:04:56.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.777523ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
46702024-11-18T21:04:57.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3a2472c-b59c-4692-a273-ea4e0a96022c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46712024-11-18T21:04:57.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3a2472c-b59c-4692-a273-ea4e0a96022c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46722024-11-18T21:04:57.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3a2472c-b59c-4692-a273-ea4e0a96022c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46732024-11-18T21:04:58.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1d600b6-5ce3-406d-a4e2-6e6f738adfb3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46742024-11-18T21:04:58.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1d600b6-5ce3-406d-a4e2-6e6f738adfb3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46752024-11-18T21:04:58.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1d600b6-5ce3-406d-a4e2-6e6f738adfb3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46762024-11-18T21:04:59.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 187d9471-8c92-4bba-9986-34c8069b2686 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46772024-11-18T21:04:59.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 187d9471-8c92-4bba-9986-34c8069b2686 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46782024-11-18T21:04:59.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 187d9471-8c92-4bba-9986-34c8069b2686 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46792024-11-18T21:05:00.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ddf99d1-f16d-4e69-88ae-ac9365d5fdae roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46802024-11-18T21:05:00.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ddf99d1-f16d-4e69-88ae-ac9365d5fdae resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46812024-11-18T21:05:00.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ddf99d1-f16d-4e69-88ae-ac9365d5fdae response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46822024-11-18T21:05:01.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7d1f21fe-6ea0-413b-ba51-71ebc6a105d0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46832024-11-18T21:05:01.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7d1f21fe-6ea0-413b-ba51-71ebc6a105d0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46842024-11-18T21:05:01.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7d1f21fe-6ea0-413b-ba51-71ebc6a105d0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46852024-11-18T21:05:02.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ef5c29e5-eec8-4a7c-9e7f-bffeb8bf9871 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46862024-11-18T21:05:02.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ef5c29e5-eec8-4a7c-9e7f-bffeb8bf9871 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46872024-11-18T21:05:02.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ef5c29e5-eec8-4a7c-9e7f-bffeb8bf9871 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46882024-11-18T21:05:03.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 91e5aa3e-4402-4075-8db5-0fe328520255 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46892024-11-18T21:05:03.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 91e5aa3e-4402-4075-8db5-0fe328520255 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46902024-11-18T21:05:03.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 91e5aa3e-4402-4075-8db5-0fe328520255 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46912024-11-18T21:05:04.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87b75f2f-9979-40ad-a3e4-0898d7979450 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46922024-11-18T21:05:04.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87b75f2f-9979-40ad-a3e4-0898d7979450 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46932024-11-18T21:05:04.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87b75f2f-9979-40ad-a3e4-0898d7979450 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46942024-11-18T21:05:05.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3153d8c-79c1-42bf-acc3-be566b4d6791 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46952024-11-18T21:05:05.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3153d8c-79c1-42bf-acc3-be566b4d6791 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46962024-11-18T21:05:05.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3153d8c-79c1-42bf-acc3-be566b4d6791 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
46972024-11-18T21:05:05.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 7e1e520c-745b-441c-b176-80852aa5590d response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
46982024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
46992024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47002024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
47012024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47022024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
47032024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47042024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
47052024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47062024-11-18T21:05:06.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47072024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47082024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
47092024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
47102024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
47112024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
47122024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47132024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
47142024-11-18T21:05:06.238ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:55:06.238035307 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47152024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
47162024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47172024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47182024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47192024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47202024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47212024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47222024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47232024-11-18T21:05:06.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 553938236 } })
47242024-11-18T21:05:06.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 553967737 } })
47252024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
47262024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
47272024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47282024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
47292024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47302024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47312024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47322024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
47332024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
47342024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
47352024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47362024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47372024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47382024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
47392024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47402024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
47412024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
47422024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47432024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
47442024-11-18T21:05:06.238ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
47452024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47462024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.91\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
47472024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
47482024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
47492024-11-18T21:05:06.238ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47502024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47512024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47522024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
47532024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
47542024-11-18T21:05:06.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47552024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
47562024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47572024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
47582024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47592024-11-18T21:05:06.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47602024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
47612024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47622024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
47632024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47642024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
47652024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47662024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
47672024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47682024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
47692024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 974.848\u{b5}s iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
47702024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47712024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47722024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47732024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47742024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47752024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47762024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47772024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47782024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47792024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47802024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47812024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47822024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47832024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
47842024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47852024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
47862024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.41544ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
47872024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47882024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47892024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47902024-11-18T21:05:06.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47912024-11-18T21:05:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47922024-11-18T21:05:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47932024-11-18T21:05:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47942024-11-18T21:05:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47952024-11-18T21:05:06.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 556322644 } })
47962024-11-18T21:05:06.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
47972024-11-18T21:05:06.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47982024-11-18T21:05:06.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47992024-11-18T21:05:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48002024-11-18T21:05:06.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 557607744 } })
48012024-11-18T21:05:06.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
48022024-11-18T21:05:06.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:55:06.238035307 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48032024-11-18T21:05:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.556908ms iteration = 5 status = {"expiration":"2024-11-18T20:55:06.238035307Z","pruned":[]}
48042024-11-18T21:05:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48052024-11-18T21:05:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48062024-11-18T21:05:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48072024-11-18T21:05:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48082024-11-18T21:05:06.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-11-18T21:05:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102024-11-18T21:05:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.416155ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48112024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48122024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48132024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48142024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48152024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48162024-11-18T21:05:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48172024-11-18T21:05:06.249ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48182024-11-18T21:05:06.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192024-11-18T21:05:06.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48202024-11-18T21:05:06.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48212024-11-18T21:05:06.252ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.677673ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
48222024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48232024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48242024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48252024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48262024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48272024-11-18T21:05:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48282024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48292024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
48312024-11-18T21:05:06.254ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
48322024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.379515ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
48332024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48342024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48352024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48362024-11-18T21:05:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48372024-11-18T21:05:06.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48382024-11-18T21:05:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48392024-11-18T21:05:06.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48402024-11-18T21:05:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48412024-11-18T21:05:06.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48422024-11-18T21:05:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48432024-11-18T21:05:06.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48442024-11-18T21:05:06.263ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 578934103 } })
48452024-11-18T21:05:06.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48462024-11-18T21:05:06.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48472024-11-18T21:05:06.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
48482024-11-18T21:05:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48492024-11-18T21:05:06.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48502024-11-18T21:05:06.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48512024-11-18T21:05:06.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48522024-11-18T21:05:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
48532024-11-18T21:05:06.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48542024-11-18T21:05:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48552024-11-18T21:05:06.275ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48562024-11-18T21:05:06.275ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48572024-11-18T21:05:06.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48582024-11-18T21:05:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48592024-11-18T21:05:06.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-11-18T21:05:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48612024-11-18T21:05:06.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48622024-11-18T21:05:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48632024-11-18T21:05:06.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48642024-11-18T21:05:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48652024-11-18T21:05:06.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48662024-11-18T21:05:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48672024-11-18T21:05:06.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.803243ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
48682024-11-18T21:05:06.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48692024-11-18T21:05:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48702024-11-18T21:05:06.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-11-18T21:05:06.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48722024-11-18T21:05:06.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48732024-11-18T21:05:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48742024-11-18T21:05:06.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.572619ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48752024-11-18T21:05:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48762024-11-18T21:05:06.301ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48772024-11-18T21:05:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.758619ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48782024-11-18T21:05:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48792024-11-18T21:05:06.303ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48802024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48812024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48822024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48832024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48842024-11-18T21:05:06.304ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
48852024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 65.431598ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48862024-11-18T21:05:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48872024-11-18T21:05:06.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.761785ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
48882024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48892024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48902024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48912024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48922024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48932024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48942024-11-18T21:05:06.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48952024-11-18T21:05:06.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48962024-11-18T21:05:06.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48972024-11-18T21:05:06.413ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48982024-11-18T21:05:06.413ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48992024-11-18T21:05:06.413ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64936cb3-8944-4d4d-8826-9beddff9d02b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49002024-11-18T21:05:06.413ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49012024-11-18T21:05:06.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49022024-11-18T21:05:06.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 977e81b1-f40a-4498-a38e-d53e6a8a6eed roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
49032024-11-18T21:05:06.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 977e81b1-f40a-4498-a38e-d53e6a8a6eed resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
49042024-11-18T21:05:06.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
49052024-11-18T21:05:06.423ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49062024-11-18T21:05:06.423ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90cb74ce-4ca6-4efc-9c56-1d5ba0755a2d", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49072024-11-18T21:05:06.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49082024-11-18T21:05:06.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49092024-11-18T21:05:06.450ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
49102024-11-18T21:05:06.450ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49112024-11-18T21:05:06.450ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48c09568-85cf-4408-af46-e10a279ad917", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49122024-11-18T21:05:06.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49132024-11-18T21:05:06.452ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
49142024-11-18T21:05:06.452ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49152024-11-18T21:05:06.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49162024-11-18T21:05:06.453ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4811f21b-1f92-401b-b106-8e9f4f95ab7c", "content-length": "372", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49172024-11-18T21:05:06.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49182024-11-18T21:05:06.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49192024-11-18T21:05:06.455ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49202024-11-18T21:05:06.455ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49212024-11-18T21:05:06.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49222024-11-18T21:05:06.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49232024-11-18T21:05:06.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 218.5521ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49242024-11-18T21:05:06.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49252024-11-18T21:05:06.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49262024-11-18T21:05:06.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49272024-11-18T21:05:06.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49282024-11-18T21:05:06.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49292024-11-18T21:05:06.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-11-18T21:05:06.460ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
49312024-11-18T21:05:06.460ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.23419ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49322024-11-18T21:05:06.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 977e81b1-f40a-4498-a38e-d53e6a8a6eed response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
49332024-11-18T21:05:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49342024-11-18T21:05:06.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49352024-11-18T21:05:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49362024-11-18T21:05:06.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49372024-11-18T21:05:06.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49382024-11-18T21:05:06.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49392024-11-18T21:05:06.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49402024-11-18T21:05:06.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 257.628532ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49412024-11-18T21:05:06.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 258.393078ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49422024-11-18T21:05:06.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432024-11-18T21:05:06.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49442024-11-18T21:05:06.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49452024-11-18T21:05:06.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49462024-11-18T21:05:06.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49472024-11-18T21:05:06.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49482024-11-18T21:05:06.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
49492024-11-18T21:05:06.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49502024-11-18T21:05:06.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49512024-11-18T21:05:06.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49522024-11-18T21:05:06.506ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49532024-11-18T21:05:06.506ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49542024-11-18T21:05:06.506ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "21d587ce-fe7c-47b9-bf14-3553ae22d616", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49552024-11-18T21:05:06.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49562024-11-18T21:05:06.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49572024-11-18T21:05:06.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49582024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49592024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49602024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49612024-11-18T21:05:06.508ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49622024-11-18T21:05:06.508ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49632024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 269.55142ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49642024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49652024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49662024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49672024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49682024-11-18T21:05:06.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692024-11-18T21:05:06.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49702024-11-18T21:05:06.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49712024-11-18T21:05:06.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49722024-11-18T21:05:06.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
49732024-11-18T21:05:06.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49742024-11-18T21:05:06.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49752024-11-18T21:05:06.516ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 277.371338ms iteration = 9 status = 0
49762024-11-18T21:05:06.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49772024-11-18T21:05:06.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49782024-11-18T21:05:06.518ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
49792024-11-18T21:05:06.518ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 279.633876ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
49802024-11-18T21:05:06.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49812024-11-18T21:05:06.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49822024-11-18T21:05:06.524ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49832024-11-18T21:05:06.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49842024-11-18T21:05:06.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f4c57d9a-393c-4149-83d2-18ae4647d7f3", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
49852024-11-18T21:05:06.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
49862024-11-18T21:05:06.526ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.508795ms iteration = 9 status = {}
49872024-11-18T21:05:06.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-11-18T21:05:06.539ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49892024-11-18T21:05:06.539ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
49902024-11-18T21:05:06.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49912024-11-18T21:05:06.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49922024-11-18T21:05:06.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49932024-11-18T21:05:06.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49942024-11-18T21:05:06.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49952024-11-18T21:05:06.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
49962024-11-18T21:05:06.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972024-11-18T21:05:06.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49982024-11-18T21:05:06.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49992024-11-18T21:05:06.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50002024-11-18T21:05:06.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012024-11-18T21:05:06.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50022024-11-18T21:05:06.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50032024-11-18T21:05:06.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50042024-11-18T21:05:06.574ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50052024-11-18T21:05:06.574ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da618a3e-4390-4d75-8f3b-6e3e8045c16b", "content-length": "1", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} })
50062024-11-18T21:05:06.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50072024-11-18T21:05:06.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50082024-11-18T21:05:06.589ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
50092024-11-18T21:05:06.589ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 351.510432ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50102024-11-18T21:05:06.597ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 359.480921ms iteration = 9 status = {}
50112024-11-18T21:05:06.621ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 382.322372ms iteration = 11 status = {"physical_disks_added":0}
50122024-11-18T21:05:06.653ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50132024-11-18T21:05:06.654ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "468d9836-f0a5-46a1-b6fb-7836ebc563cf", "content-length": "691", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} })
50142024-11-18T21:05:06.654ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50152024-11-18T21:05:06.654ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50162024-11-18T21:05:06.654ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50172024-11-18T21:05:06.655ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
50182024-11-18T21:05:06.656ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50192024-11-18T21:05:06.656ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
50202024-11-18T21:05:06.656ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 418.070028ms iteration = 5 status = {"generation":2}
50212024-11-18T21:05:06.656ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.659405ms iteration = 9 status = {}
50222024-11-18T21:05:06.656ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 418.663303ms iteration = 9 status = null
50232024-11-18T21:05:06.657ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
50242024-11-18T21:05:06.657ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50252024-11-18T21:05:06.657ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
50262024-11-18T21:05:06.657ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 419.477848ms iteration = 5 status = {"generation":1}
50272024-11-18T21:05:06.763ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50282024-11-18T21:05:06.764ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e11eaa3c-b6ef-43c3-9a23-8267327276d1", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50292024-11-18T21:05:06.764ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50302024-11-18T21:05:06.765ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "487c43da-a42f-4b33-99f4-91e5fc3496e5", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50312024-11-18T21:05:06.765ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50322024-11-18T21:05:06.766ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50332024-11-18T21:05:06.766ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50342024-11-18T21:05:06.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 528.607222ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50352024-11-18T21:05:06.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50362024-11-18T21:05:06.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50372024-11-18T21:05:06.793ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
50382024-11-18T21:05:06.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50392024-11-18T21:05:06.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50402024-11-18T21:05:06.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50412024-11-18T21:05:06.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "348b1d9c-a3a2-4a94-82c9-98ee38eec67f", "content-length": "134", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} })
50422024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50432024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
50442024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50452024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50462024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50472024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50482024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50492024-11-18T21:05:06.801ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50502024-11-18T21:05:06.802ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50512024-11-18T21:05:06.802ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50522024-11-18T21:05:06.802ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
50532024-11-18T21:05:06.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50542024-11-18T21:05:06.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50552024-11-18T21:05:06.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50562024-11-18T21:05:06.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad8f0f5-383e-42cc-924f-f41e370c9194", "content-length": "2", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} })
50572024-11-18T21:05:06.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50582024-11-18T21:05:06.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "85c811e0-1370-4c9d-81d6-c68b82914bf4", "content-length": "51", "date": "Mon, 18 Nov 2024 21:05:05 GMT"} })
50592024-11-18T21:05:06.804ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
50602024-11-18T21:05:06.804ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50612024-11-18T21:05:06.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50622024-11-18T21:05:06.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6d40a426-af96-41a7-83b4-371a8ec33a5a", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50632024-11-18T21:05:06.812ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50642024-11-18T21:05:06.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "12c03e2f-d4db-4e5a-b266-d879415b7c95", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50652024-11-18T21:05:06.814ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50662024-11-18T21:05:06.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dc093e58-9914-4b98-a448-cf8ef3e1c316", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50672024-11-18T21:05:06.815ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50682024-11-18T21:05:06.816ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
50692024-11-18T21:05:06.816ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 578.924247ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50702024-11-18T21:05:06.895ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9cca91f1-7b63-4951-a440-6e98ac624012", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
50712024-11-18T21:05:06.896ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
50722024-11-18T21:05:06.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50732024-11-18T21:05:06.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "920757aa-c6b6-4cb8-b5f2-868f95a3addb", "content-length": "682", "date": "Mon, 18 Nov 2024 21:05:06 GMT"} })
50742024-11-18T21:05:06.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50752024-11-18T21:05:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50762024-11-18T21:05:06.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50772024-11-18T21:05:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50782024-11-18T21:05:06.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50792024-11-18T21:05:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50802024-11-18T21:05:06.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50812024-11-18T21:05:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50822024-11-18T21:05:06.913ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.43679ms iteration = 9 status = {}
50832024-11-18T21:05:07.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00b8fb6c-69f1-412a-ab61-600658e99f26 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50842024-11-18T21:05:07.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00b8fb6c-69f1-412a-ab61-600658e99f26 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50852024-11-18T21:05:07.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00b8fb6c-69f1-412a-ab61-600658e99f26 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50862024-11-18T21:05:08.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16122e91-d4f5-4b59-a618-485d472efd6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50872024-11-18T21:05:08.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16122e91-d4f5-4b59-a618-485d472efd6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50882024-11-18T21:05:08.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16122e91-d4f5-4b59-a618-485d472efd6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50892024-11-18T21:05:09.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f36d37bd-2505-46df-a34d-e8d9a4df9490 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50902024-11-18T21:05:09.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f36d37bd-2505-46df-a34d-e8d9a4df9490 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50912024-11-18T21:05:09.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f36d37bd-2505-46df-a34d-e8d9a4df9490 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50922024-11-18T21:05:10.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 481e93f0-346d-4e4e-89f3-37fdc05f3ee1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50932024-11-18T21:05:10.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 481e93f0-346d-4e4e-89f3-37fdc05f3ee1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50942024-11-18T21:05:10.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 481e93f0-346d-4e4e-89f3-37fdc05f3ee1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
50952024-11-18T21:05:10.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c34f19d8-b518-464a-80ff-cda955f502f6 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
50962024-11-18T21:05:10.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c34f19d8-b518-464a-80ff-cda955f502f6 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
50972024-11-18T21:05:10.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = c34f19d8-b518-464a-80ff-cda955f502f6 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
50982024-11-18T21:05:10.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6b75b5a0-2fea-4600-a856-9e0f62bd23df roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
50992024-11-18T21:05:10.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6b75b5a0-2fea-4600-a856-9e0f62bd23df resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
51002024-11-18T21:05:10.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6b75b5a0-2fea-4600-a856-9e0f62bd23df response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
51012024-11-18T21:05:11.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f15abed1-554c-4634-a7b8-111ae0e2e700 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51022024-11-18T21:05:11.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f15abed1-554c-4634-a7b8-111ae0e2e700 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51032024-11-18T21:05:11.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f15abed1-554c-4634-a7b8-111ae0e2e700 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51042024-11-18T21:05:12.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5038749-7978-4cf9-b83f-268426b0b690 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51052024-11-18T21:05:12.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5038749-7978-4cf9-b83f-268426b0b690 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51062024-11-18T21:05:12.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5038749-7978-4cf9-b83f-268426b0b690 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51072024-11-18T21:05:13.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc4458d1-4b25-410a-a7ca-d4eb086f48b8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51082024-11-18T21:05:13.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc4458d1-4b25-410a-a7ca-d4eb086f48b8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51092024-11-18T21:05:13.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc4458d1-4b25-410a-a7ca-d4eb086f48b8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51102024-11-18T21:05:14.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcaf1dcf-08d3-40d6-ac53-360bbb6489a7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51112024-11-18T21:05:14.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcaf1dcf-08d3-40d6-ac53-360bbb6489a7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51122024-11-18T21:05:14.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcaf1dcf-08d3-40d6-ac53-360bbb6489a7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51132024-11-18T21:05:15.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 966507c6-fed7-41e6-b891-6d3501121cff roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51142024-11-18T21:05:15.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 966507c6-fed7-41e6-b891-6d3501121cff resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51152024-11-18T21:05:15.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 966507c6-fed7-41e6-b891-6d3501121cff response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51162024-11-18T21:05:16.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
51172024-11-18T21:05:16.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
51182024-11-18T21:05:16.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51192024-11-18T21:05:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51202024-11-18T21:05:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51212024-11-18T21:05:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51222024-11-18T21:05:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232024-11-18T21:05:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51242024-11-18T21:05:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51252024-11-18T21:05:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51262024-11-18T21:05:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51272024-11-18T21:05:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51282024-11-18T21:05:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51292024-11-18T21:05:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51302024-11-18T21:05:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51312024-11-18T21:05:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
51322024-11-18T21:05:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51332024-11-18T21:05:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51342024-11-18T21:05:16.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
51352024-11-18T21:05:16.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.502638ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
51362024-11-18T21:05:16.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.86957ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51372024-11-18T21:05:16.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9227917d-3247-491f-873f-e04a3c771de7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51382024-11-18T21:05:16.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9227917d-3247-491f-873f-e04a3c771de7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51392024-11-18T21:05:16.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9227917d-3247-491f-873f-e04a3c771de7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51402024-11-18T21:05:17.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9629aa85-676e-423b-875d-ce14d4017ee3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51412024-11-18T21:05:17.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9629aa85-676e-423b-875d-ce14d4017ee3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51422024-11-18T21:05:17.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9629aa85-676e-423b-875d-ce14d4017ee3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51432024-11-18T21:05:18.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56a750e3-64e2-4fa9-88a2-7a9cb87f2262 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51442024-11-18T21:05:18.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56a750e3-64e2-4fa9-88a2-7a9cb87f2262 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51452024-11-18T21:05:18.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56a750e3-64e2-4fa9-88a2-7a9cb87f2262 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51462024-11-18T21:05:19.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 50fe0b14-79c8-40c4-a4f7-3c6a96271a1b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51472024-11-18T21:05:19.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 50fe0b14-79c8-40c4-a4f7-3c6a96271a1b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51482024-11-18T21:05:19.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 50fe0b14-79c8-40c4-a4f7-3c6a96271a1b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51492024-11-18T21:05:20.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d18dea81-cfb3-4988-9c92-155df5d68469 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51502024-11-18T21:05:20.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d18dea81-cfb3-4988-9c92-155df5d68469 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51512024-11-18T21:05:20.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d18dea81-cfb3-4988-9c92-155df5d68469 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51522024-11-18T21:05:20.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 9363a87b-a1d6-437f-8ef8-c6ec4a9b9838 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
51532024-11-18T21:05:21.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21677354-1b13-4a53-8d84-334e7cf9c313 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51542024-11-18T21:05:21.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21677354-1b13-4a53-8d84-334e7cf9c313 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51552024-11-18T21:05:21.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21677354-1b13-4a53-8d84-334e7cf9c313 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51562024-11-18T21:05:22.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f420e5f-0866-403a-b7bd-f87eec17835d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51572024-11-18T21:05:22.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f420e5f-0866-403a-b7bd-f87eec17835d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51582024-11-18T21:05:22.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f420e5f-0866-403a-b7bd-f87eec17835d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51592024-11-18T21:05:23.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a9a815e-d251-4072-abe2-5c9cd85a55d2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51602024-11-18T21:05:23.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a9a815e-d251-4072-abe2-5c9cd85a55d2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51612024-11-18T21:05:23.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a9a815e-d251-4072-abe2-5c9cd85a55d2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51622024-11-18T21:05:24.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7fc99476-2c9a-4212-9ab3-d3bd1e1388da roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51632024-11-18T21:05:24.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7fc99476-2c9a-4212-9ab3-d3bd1e1388da resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51642024-11-18T21:05:24.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7fc99476-2c9a-4212-9ab3-d3bd1e1388da response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51652024-11-18T21:05:25.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39b4d6e2-775e-4f2a-a788-6913d6b3b791 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51662024-11-18T21:05:25.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39b4d6e2-775e-4f2a-a788-6913d6b3b791 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51672024-11-18T21:05:25.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39b4d6e2-775e-4f2a-a788-6913d6b3b791 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51682024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
51692024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
51702024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51712024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51722024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51732024-11-18T21:05:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51742024-11-18T21:05:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51752024-11-18T21:05:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51762024-11-18T21:05:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.778338ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51772024-11-18T21:05:26.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51782024-11-18T21:05:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51792024-11-18T21:05:26.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51802024-11-18T21:05:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51812024-11-18T21:05:26.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51822024-11-18T21:05:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51832024-11-18T21:05:26.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51842024-11-18T21:05:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
51852024-11-18T21:05:26.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51862024-11-18T21:05:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51872024-11-18T21:05:26.290ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
51882024-11-18T21:05:26.290ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.92147ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
51892024-11-18T21:05:26.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94fcad9d-5a65-4148-a88c-e3b490f75c24 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51902024-11-18T21:05:26.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94fcad9d-5a65-4148-a88c-e3b490f75c24 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51912024-11-18T21:05:26.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94fcad9d-5a65-4148-a88c-e3b490f75c24 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51922024-11-18T21:05:27.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c05b0168-1cd0-46e9-a383-30c4d966492e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51932024-11-18T21:05:27.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c05b0168-1cd0-46e9-a383-30c4d966492e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51942024-11-18T21:05:27.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c05b0168-1cd0-46e9-a383-30c4d966492e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51952024-11-18T21:05:28.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35165597-3fdb-4a4f-9c15-ff0801aea747 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51962024-11-18T21:05:28.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35165597-3fdb-4a4f-9c15-ff0801aea747 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51972024-11-18T21:05:28.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35165597-3fdb-4a4f-9c15-ff0801aea747 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51982024-11-18T21:05:29.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0432c515-af5d-4b25-af7d-b0ded4844726 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
51992024-11-18T21:05:29.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0432c515-af5d-4b25-af7d-b0ded4844726 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52002024-11-18T21:05:29.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0432c515-af5d-4b25-af7d-b0ded4844726 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52012024-11-18T21:05:30.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16e47405-37f1-43cf-b002-a765384aba29 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52022024-11-18T21:05:30.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16e47405-37f1-43cf-b002-a765384aba29 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52032024-11-18T21:05:30.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16e47405-37f1-43cf-b002-a765384aba29 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52042024-11-18T21:05:32.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1e32f77-2125-4802-9063-e913bf97dc45 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52052024-11-18T21:05:32.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1e32f77-2125-4802-9063-e913bf97dc45 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52062024-11-18T21:05:32.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1e32f77-2125-4802-9063-e913bf97dc45 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52072024-11-18T21:05:33.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 503d0344-881c-48c0-a0ba-61afd0019b68 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52082024-11-18T21:05:33.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 503d0344-881c-48c0-a0ba-61afd0019b68 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52092024-11-18T21:05:33.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 503d0344-881c-48c0-a0ba-61afd0019b68 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52102024-11-18T21:05:34.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 735cedd5-2167-40c6-9cbd-d6ee2acad79e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52112024-11-18T21:05:34.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 735cedd5-2167-40c6-9cbd-d6ee2acad79e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52122024-11-18T21:05:34.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 735cedd5-2167-40c6-9cbd-d6ee2acad79e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52132024-11-18T21:05:35.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6f18ac9e-78ac-4935-8c99-8b8cd0358c5b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52142024-11-18T21:05:35.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6f18ac9e-78ac-4935-8c99-8b8cd0358c5b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52152024-11-18T21:05:35.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6f18ac9e-78ac-4935-8c99-8b8cd0358c5b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52162024-11-18T21:05:35.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = a4d43d82-1fee-4ac4-bce3-fc7845ed49a2 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
52172024-11-18T21:05:36.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ecefb055-5ed2-4887-8717-be7b98d5b560 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52182024-11-18T21:05:36.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ecefb055-5ed2-4887-8717-be7b98d5b560 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52192024-11-18T21:05:36.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ecefb055-5ed2-4887-8717-be7b98d5b560 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
52202024-11-18T21:05:36.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
52212024-11-18T21:05:36.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52222024-11-18T21:05:36.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
52232024-11-18T21:05:36.238ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52242024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52252024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52262024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
52272024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
52282024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
52292024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52302024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52312024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52322024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
52332024-11-18T21:05:36.239ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52342024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
52352024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52362024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52372024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
52382024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52392024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
52402024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
52412024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
52422024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52432024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52442024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52452024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
52462024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52472024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
52482024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52492024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
52502024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52512024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
52522024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52532024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
52542024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52552024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52562024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
52572024-11-18T21:05:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52582024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52592024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52602024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52612024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52622024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52632024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52642024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52652024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52662024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52672024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52682024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52692024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52702024-11-18T21:05:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52712024-11-18T21:05:36.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 556510546 } })
52722024-11-18T21:05:36.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
52732024-11-18T21:05:36.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 557015139 } })
52742024-11-18T21:05:36.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
52752024-11-18T21:05:36.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-11-18T21:05:36.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772024-11-18T21:05:36.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-11-18T21:05:36.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.97851ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52792024-11-18T21:05:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52802024-11-18T21:05:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52812024-11-18T21:05:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52822024-11-18T21:05:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52832024-11-18T21:05:36.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52842024-11-18T21:05:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52852024-11-18T21:05:36.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52862024-11-18T21:05:36.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52872024-11-18T21:05:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52882024-11-18T21:05:36.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52892024-11-18T21:05:36.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902024-11-18T21:05:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52912024-11-18T21:05:36.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 567757539 } })
52922024-11-18T21:05:36.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
52932024-11-18T21:05:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52942024-11-18T21:05:36.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52952024-11-18T21:05:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52962024-11-18T21:05:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52972024-11-18T21:05:36.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52982024-11-18T21:05:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52992024-11-18T21:05:36.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53002024-11-18T21:05:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53012024-11-18T21:05:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022024-11-18T21:05:36.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53032024-11-18T21:05:36.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53042024-11-18T21:05:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53052024-11-18T21:05:36.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53062024-11-18T21:05:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53072024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53082024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53092024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53102024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53112024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53122024-11-18T21:05:36.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53132024-11-18T21:05:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53142024-11-18T21:05:36.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53152024-11-18T21:05:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53162024-11-18T21:05:36.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53172024-11-18T21:05:36.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53182024-11-18T21:05:36.284ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53192024-11-18T21:05:36.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53202024-11-18T21:05:36.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.905285ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
53212024-11-18T21:05:36.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53222024-11-18T21:05:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53232024-11-18T21:05:36.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.865569ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
53242024-11-18T21:05:36.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53252024-11-18T21:05:36.292ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53262024-11-18T21:05:36.292ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53272024-11-18T21:05:36.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53282024-11-18T21:05:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53292024-11-18T21:05:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53302024-11-18T21:05:36.295ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53312024-11-18T21:05:36.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53322024-11-18T21:05:36.300ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53332024-11-18T21:05:36.300ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.647982ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53342024-11-18T21:05:36.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53352024-11-18T21:05:36.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53362024-11-18T21:05:36.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53372024-11-18T21:05:36.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53382024-11-18T21:05:36.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53392024-11-18T21:05:36.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
53402024-11-18T21:05:36.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53412024-11-18T21:05:36.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53422024-11-18T21:05:36.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53432024-11-18T21:05:36.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53442024-11-18T21:05:36.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.49568ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53452024-11-18T21:05:36.335ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
53462024-11-18T21:05:36.335ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.607854ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
53472024-11-18T21:05:36.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.314228ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53482024-11-18T21:05:36.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53492024-11-18T21:05:36.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53502024-11-18T21:05:36.337ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53512024-11-18T21:05:36.337ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b42dd3f-da33-40c4-a0c9-49b7b7b5556a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
53522024-11-18T21:05:36.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53532024-11-18T21:05:36.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53542024-11-18T21:05:36.338ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53552024-11-18T21:05:36.338ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "921bed94-37c6-43d1-ae1a-ce4c2d8d27c2", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
53562024-11-18T21:05:36.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53572024-11-18T21:05:36.339ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53582024-11-18T21:05:36.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53592024-11-18T21:05:36.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
53602024-11-18T21:05:36.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53612024-11-18T21:05:36.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53622024-11-18T21:05:36.343ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.24543ms iteration = 10 status = 0
53632024-11-18T21:05:36.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
53642024-11-18T21:05:36.344ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53652024-11-18T21:05:36.345ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14109387-4be3-46f3-af61-051d2d3c99d2", "content-length": "26", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
53662024-11-18T21:05:36.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53672024-11-18T21:05:36.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.466297ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53682024-11-18T21:05:36.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
53692024-11-18T21:05:36.348ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53702024-11-18T21:05:36.348ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53712024-11-18T21:05:36.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53722024-11-18T21:05:36.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53732024-11-18T21:05:36.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.214874ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53742024-11-18T21:05:36.379ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53752024-11-18T21:05:36.380ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53762024-11-18T21:05:36.380ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.059664ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53772024-11-18T21:05:36.380ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.508708ms iteration = 12 status = {"physical_disks_added":0}
53782024-11-18T21:05:36.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53792024-11-18T21:05:36.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53802024-11-18T21:05:36.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812024-11-18T21:05:36.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53822024-11-18T21:05:36.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53832024-11-18T21:05:36.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53842024-11-18T21:05:36.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852024-11-18T21:05:36.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53862024-11-18T21:05:36.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53872024-11-18T21:05:36.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53882024-11-18T21:05:36.442ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.053332ms iteration = 10 status = {}
53892024-11-18T21:05:36.449ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53902024-11-18T21:05:36.449ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a73dfa2-68cc-4991-aede-bc6176c1e019", "content-length": "1", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
53912024-11-18T21:05:36.450ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53922024-11-18T21:05:36.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53932024-11-18T21:05:36.452ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.752984ms iteration = 10 status = null
53942024-11-18T21:05:36.458ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53952024-11-18T21:05:36.458ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53962024-11-18T21:05:36.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ebd837-caea-4e21-bf62-f53d12dd68f0", "content-length": "372", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
53972024-11-18T21:05:36.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53982024-11-18T21:05:36.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53992024-11-18T21:05:36.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54002024-11-18T21:05:36.500ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54012024-11-18T21:05:36.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54022024-11-18T21:05:36.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54032024-11-18T21:05:36.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54042024-11-18T21:05:36.541ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
54052024-11-18T21:05:36.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54062024-11-18T21:05:36.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54072024-11-18T21:05:36.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54082024-11-18T21:05:36.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e2ca9d-8c01-4ec6-bdfe-21c0712c48b2", "content-length": "134", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54092024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54102024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
54112024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54122024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54132024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54142024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54152024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54162024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54172024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54182024-11-18T21:05:36.552ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54192024-11-18T21:05:36.553ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
54202024-11-18T21:05:36.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54212024-11-18T21:05:36.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54222024-11-18T21:05:36.555ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54232024-11-18T21:05:36.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c2447f3-7c99-48ee-8db3-f8a2e286323f", "content-length": "2", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54242024-11-18T21:05:36.555ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54252024-11-18T21:05:36.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "906a2623-dcb3-4ee4-a1f2-012c36ce5ae6", "content-length": "51", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54262024-11-18T21:05:36.555ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
54272024-11-18T21:05:36.555ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54282024-11-18T21:05:36.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c85be70-93d6-4c38-b4c2-7da32f9b572e", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54292024-11-18T21:05:36.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54302024-11-18T21:05:36.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54312024-11-18T21:05:36.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04483a40-6ce7-4c8c-a4f5-31fc7d6e2114", "content-length": "691", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54322024-11-18T21:05:36.588ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54332024-11-18T21:05:36.588ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54342024-11-18T21:05:36.588ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54352024-11-18T21:05:36.589ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 349.791379ms iteration = 10 status = {}
54362024-11-18T21:05:36.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54372024-11-18T21:05:36.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54382024-11-18T21:05:36.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54392024-11-18T21:05:36.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54402024-11-18T21:05:36.596ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54412024-11-18T21:05:36.596ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54422024-11-18T21:05:36.597ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cb22acae-dafc-41f1-a7dd-a26ebe87784a", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54432024-11-18T21:05:36.598ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.843876ms iteration = 10 status = {}
54442024-11-18T21:05:36.663ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
54452024-11-18T21:05:36.663ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
54462024-11-18T21:05:36.693ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
54472024-11-18T21:05:36.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1bcb405b-a8e9-4a7b-bc58-bc5aebda9c4c", "date": "Mon, 18 Nov 2024 21:05:36 GMT"} })
54482024-11-18T21:05:36.693ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
54492024-11-18T21:05:36.693ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63009
54502024-11-18T21:05:36.693ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54512024-11-18T21:05:36.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63009 req_id = bfaa9283-c8e7-4d9e-a17f-7a164c1ba184 roles = RoleSet { roles: {} } uri = /metrics/producers
54522024-11-18T21:05:36.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d166007a-4358-4469-a61a-ad50ccc39037", "content-length": "682", "date": "Mon, 18 Nov 2024 21:05:35 GMT"} })
54532024-11-18T21:05:36.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54542024-11-18T21:05:36.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63009 req_id = bfaa9283-c8e7-4d9e-a17f-7a164c1ba184 resource = Database result = Ok(()) uri = /metrics/producers
54552024-11-18T21:05:36.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54562024-11-18T21:05:36.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54572024-11-18T21:05:36.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54582024-11-18T21:05:36.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54592024-11-18T21:05:36.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54602024-11-18T21:05:36.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54612024-11-18T21:05:36.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54622024-11-18T21:05:36.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.340451ms iteration = 10 status = {}
54632024-11-18T21:05:36.728ZINFOnexus: assigned collector to new producer collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 file = nexus/src/app/oximeter.rs:76 producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
54642024-11-18T21:05:36.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34513 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63009 req_id = bfaa9283-c8e7-4d9e-a17f-7a164c1ba184 response_code = 201 uri = /metrics/producers
54652024-11-18T21:05:36.728ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bfaa9283-c8e7-4d9e-a17f-7a164c1ba184", "content-length": "41", "date": "Mon, 18 Nov 2024 21:05:36 GMT"} })
54662024-11-18T21:05:36.729ZDEBGnexus (producer-registration-task): registered with nexus successfully
54672024-11-18T21:05:36.729ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
54682024-11-18T21:05:37.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f6a69c2-c878-43ab-b0b3-38adfe8caa16 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54692024-11-18T21:05:37.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f6a69c2-c878-43ab-b0b3-38adfe8caa16 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54702024-11-18T21:05:37.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f6a69c2-c878-43ab-b0b3-38adfe8caa16 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54712024-11-18T21:05:38.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 516a8d9f-feec-4adb-8010-c2f0988b8421 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54722024-11-18T21:05:38.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 516a8d9f-feec-4adb-8010-c2f0988b8421 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54732024-11-18T21:05:38.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 516a8d9f-feec-4adb-8010-c2f0988b8421 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54742024-11-18T21:05:39.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f23c59cb-d26f-40f1-bd1f-04e236b1ac00 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54752024-11-18T21:05:39.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f23c59cb-d26f-40f1-bd1f-04e236b1ac00 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54762024-11-18T21:05:39.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f23c59cb-d26f-40f1-bd1f-04e236b1ac00 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54772024-11-18T21:05:40.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e6f1d22f-74db-4f3c-9bfa-c1fc5b6be920 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54782024-11-18T21:05:40.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e6f1d22f-74db-4f3c-9bfa-c1fc5b6be920 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54792024-11-18T21:05:40.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e6f1d22f-74db-4f3c-9bfa-c1fc5b6be920 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54802024-11-18T21:05:41.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8763b337-89e0-41ca-83b5-3a798b3644e0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54812024-11-18T21:05:41.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8763b337-89e0-41ca-83b5-3a798b3644e0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54822024-11-18T21:05:41.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8763b337-89e0-41ca-83b5-3a798b3644e0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54832024-11-18T21:05:42.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31162f82-620d-41d3-8367-037ea262db68 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54842024-11-18T21:05:42.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31162f82-620d-41d3-8367-037ea262db68 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54852024-11-18T21:05:42.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31162f82-620d-41d3-8367-037ea262db68 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54862024-11-18T21:05:43.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eea4f9e4-2118-4726-be0f-7c1d4c4097d1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54872024-11-18T21:05:43.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eea4f9e4-2118-4726-be0f-7c1d4c4097d1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54882024-11-18T21:05:43.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eea4f9e4-2118-4726-be0f-7c1d4c4097d1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54892024-11-18T21:05:44.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e74670ba-e7af-4fb5-a860-f582b77caaa8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54902024-11-18T21:05:44.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e74670ba-e7af-4fb5-a860-f582b77caaa8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54912024-11-18T21:05:44.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e74670ba-e7af-4fb5-a860-f582b77caaa8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54922024-11-18T21:05:45.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2396c85c-bdd1-461a-bf07-d5c6f7398bdf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54932024-11-18T21:05:45.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2396c85c-bdd1-461a-bf07-d5c6f7398bdf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54942024-11-18T21:05:45.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2396c85c-bdd1-461a-bf07-d5c6f7398bdf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
54952024-11-18T21:05:46.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
54962024-11-18T21:05:46.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
54972024-11-18T21:05:46.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54982024-11-18T21:05:46.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-11-18T21:05:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55002024-11-18T21:05:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55012024-11-18T21:05:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55022024-11-18T21:05:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55032024-11-18T21:05:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55042024-11-18T21:05:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55052024-11-18T21:05:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55062024-11-18T21:05:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55072024-11-18T21:05:46.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55082024-11-18T21:05:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
55092024-11-18T21:05:46.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55102024-11-18T21:05:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55112024-11-18T21:05:46.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
55122024-11-18T21:05:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.199714ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
55132024-11-18T21:05:46.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55142024-11-18T21:05:46.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55152024-11-18T21:05:46.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.272226ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55162024-11-18T21:05:46.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4329b38-8937-41f4-9d7a-6a9d4ff57606 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55172024-11-18T21:05:46.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4329b38-8937-41f4-9d7a-6a9d4ff57606 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55182024-11-18T21:05:46.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4329b38-8937-41f4-9d7a-6a9d4ff57606 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55192024-11-18T21:05:47.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 709c0761-7f6a-4090-9fe2-105f16c1fe2d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55202024-11-18T21:05:47.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 709c0761-7f6a-4090-9fe2-105f16c1fe2d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55212024-11-18T21:05:47.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 709c0761-7f6a-4090-9fe2-105f16c1fe2d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55222024-11-18T21:05:48.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1f4f3bb3-20a9-454d-a0f2-473072bd96de roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55232024-11-18T21:05:48.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1f4f3bb3-20a9-454d-a0f2-473072bd96de resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55242024-11-18T21:05:48.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1f4f3bb3-20a9-454d-a0f2-473072bd96de response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55252024-11-18T21:05:49.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 74219cec-2597-4534-9182-6ad1b972459f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55262024-11-18T21:05:49.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 74219cec-2597-4534-9182-6ad1b972459f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55272024-11-18T21:05:49.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 74219cec-2597-4534-9182-6ad1b972459f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55282024-11-18T21:05:50.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81bd9be3-4963-49a6-95f7-a0c5314979a6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55292024-11-18T21:05:50.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81bd9be3-4963-49a6-95f7-a0c5314979a6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55302024-11-18T21:05:50.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81bd9be3-4963-49a6-95f7-a0c5314979a6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55312024-11-18T21:05:50.873ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 5cb6f2d1-0f75-4b29-b881-2e301f36fb9a response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
55322024-11-18T21:05:51.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4af2197-7366-4470-981a-de18ef6edfe9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55332024-11-18T21:05:51.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4af2197-7366-4470-981a-de18ef6edfe9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55342024-11-18T21:05:51.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4af2197-7366-4470-981a-de18ef6edfe9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55352024-11-18T21:05:52.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26d572c7-c439-4a1f-8cfe-82236a283880 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55362024-11-18T21:05:52.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26d572c7-c439-4a1f-8cfe-82236a283880 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55372024-11-18T21:05:52.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26d572c7-c439-4a1f-8cfe-82236a283880 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55382024-11-18T21:05:53.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7dad4de8-8e52-40c0-ab2e-4084ec8486e7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55392024-11-18T21:05:53.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7dad4de8-8e52-40c0-ab2e-4084ec8486e7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55402024-11-18T21:05:53.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7dad4de8-8e52-40c0-ab2e-4084ec8486e7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55412024-11-18T21:05:54.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5016867-3475-4496-8813-72f20a2d9379 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55422024-11-18T21:05:54.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5016867-3475-4496-8813-72f20a2d9379 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55432024-11-18T21:05:54.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5016867-3475-4496-8813-72f20a2d9379 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55442024-11-18T21:05:55.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 561b18cf-2017-4324-94f3-78a56dc38d2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55452024-11-18T21:05:55.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 561b18cf-2017-4324-94f3-78a56dc38d2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55462024-11-18T21:05:55.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 561b18cf-2017-4324-94f3-78a56dc38d2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55472024-11-18T21:05:56.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
55482024-11-18T21:05:56.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
55492024-11-18T21:05:56.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55502024-11-18T21:05:56.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55512024-11-18T21:05:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55522024-11-18T21:05:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55532024-11-18T21:05:56.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55542024-11-18T21:05:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55552024-11-18T21:05:56.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55562024-11-18T21:05:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55572024-11-18T21:05:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55582024-11-18T21:05:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55592024-11-18T21:05:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55602024-11-18T21:05:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
55612024-11-18T21:05:56.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55622024-11-18T21:05:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55632024-11-18T21:05:56.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
55642024-11-18T21:05:56.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.718802ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
55652024-11-18T21:05:56.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55662024-11-18T21:05:56.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55672024-11-18T21:05:56.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.683923ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55682024-11-18T21:05:56.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8f0d115-c1f8-4dd2-bdbe-738782dbe6ef roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55692024-11-18T21:05:56.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8f0d115-c1f8-4dd2-bdbe-738782dbe6ef resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55702024-11-18T21:05:56.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8f0d115-c1f8-4dd2-bdbe-738782dbe6ef response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55712024-11-18T21:05:57.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cca688b-1154-49fd-911e-b0b1b0edd8f4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55722024-11-18T21:05:57.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cca688b-1154-49fd-911e-b0b1b0edd8f4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55732024-11-18T21:05:57.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cca688b-1154-49fd-911e-b0b1b0edd8f4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55742024-11-18T21:05:58.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd14268c-0143-4071-aeae-dd860397c86d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55752024-11-18T21:05:58.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd14268c-0143-4071-aeae-dd860397c86d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55762024-11-18T21:05:58.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cd14268c-0143-4071-aeae-dd860397c86d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55772024-11-18T21:05:59.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aebcd915-ae19-4708-9506-388eb5fa8bdd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55782024-11-18T21:05:59.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aebcd915-ae19-4708-9506-388eb5fa8bdd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55792024-11-18T21:05:59.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aebcd915-ae19-4708-9506-388eb5fa8bdd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55802024-11-18T21:06:00.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a058f308-5968-4c09-be4b-61e0b390b65d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55812024-11-18T21:06:00.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a058f308-5968-4c09-be4b-61e0b390b65d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55822024-11-18T21:06:00.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a058f308-5968-4c09-be4b-61e0b390b65d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55832024-11-18T21:06:01.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6265f081-1be6-4b44-ac9b-41fd8bc75081 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55842024-11-18T21:06:01.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6265f081-1be6-4b44-ac9b-41fd8bc75081 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55852024-11-18T21:06:01.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6265f081-1be6-4b44-ac9b-41fd8bc75081 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55862024-11-18T21:06:02.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c1cfa00-4b07-4c40-880c-a7e587cc9d29 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55872024-11-18T21:06:02.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c1cfa00-4b07-4c40-880c-a7e587cc9d29 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55882024-11-18T21:06:02.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c1cfa00-4b07-4c40-880c-a7e587cc9d29 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55892024-11-18T21:06:03.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 221cfa17-0bdc-4f7a-95d4-71b460aae1d2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55902024-11-18T21:06:03.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 221cfa17-0bdc-4f7a-95d4-71b460aae1d2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55912024-11-18T21:06:03.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 221cfa17-0bdc-4f7a-95d4-71b460aae1d2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55922024-11-18T21:06:04.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdf74fa-bb6d-4419-befd-d861fcad76cf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55932024-11-18T21:06:04.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdf74fa-bb6d-4419-befd-d861fcad76cf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55942024-11-18T21:06:04.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdf74fa-bb6d-4419-befd-d861fcad76cf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55952024-11-18T21:06:05.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81b688f9-b91b-4571-a7de-fa2afeb5a1c2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55962024-11-18T21:06:05.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81b688f9-b91b-4571-a7de-fa2afeb5a1c2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55972024-11-18T21:06:05.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 81b688f9-b91b-4571-a7de-fa2afeb5a1c2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
55982024-11-18T21:06:05.872ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 1cce96e7-cbc8-4c37-a24c-6c5e895c2362 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
55992024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
56002024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56012024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
56022024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
56032024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56042024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
56052024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56062024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
56072024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
56082024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56092024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
56102024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56112024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56122024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56132024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
56142024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
56152024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
56162024-11-18T21:06:06.239ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:56:06.239357542 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56172024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56182024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
56192024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
56202024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56212024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56222024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
56232024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
56242024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
56252024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56262024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56272024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56282024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
56292024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
56302024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56312024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
56322024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56332024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
56342024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56352024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
56362024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
56372024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56382024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56392024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
56402024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56412024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56422024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
56432024-11-18T21:06:06.239ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
56442024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.88\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
56452024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
56462024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
56472024-11-18T21:06:06.239ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
56482024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56492024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56502024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
56512024-11-18T21:06:06.239ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56522024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56532024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
56542024-11-18T21:06:06.239ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56552024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56562024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
56572024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56582024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
56592024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56602024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
56612024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56622024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56632024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
56642024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56652024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56662024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56672024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56682024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56692024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56702024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56712024-11-18T21:06:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56722024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56732024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56742024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56752024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56762024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56772024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56782024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56792024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56802024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56812024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56822024-11-18T21:06:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 554821443 } })
56832024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56842024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56852024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56862024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56872024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56882024-11-18T21:06:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 554874283 } })
56892024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56902024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56912024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
56922024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.387161ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
56932024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56942024-11-18T21:06:06.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.474631ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56952024-11-18T21:06:06.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56962024-11-18T21:06:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56972024-11-18T21:06:06.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 557025519 } })
56982024-11-18T21:06:06.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
56992024-11-18T21:06:06.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57002024-11-18T21:06:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57012024-11-18T21:06:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.99355ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57022024-11-18T21:06:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57032024-11-18T21:06:06.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:56:06.239357542 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57042024-11-18T21:06:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.891657ms iteration = 6 status = {"expiration":"2024-11-18T20:56:06.239357542Z","pruned":[]}
57052024-11-18T21:06:06.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 559296796 } })
57062024-11-18T21:06:06.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
57072024-11-18T21:06:06.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57082024-11-18T21:06:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57092024-11-18T21:06:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57102024-11-18T21:06:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112024-11-18T21:06:06.248ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.079147ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
57122024-11-18T21:06:06.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57132024-11-18T21:06:06.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.900474ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
57142024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57152024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57162024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57172024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57182024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57192024-11-18T21:06:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57202024-11-18T21:06:06.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57212024-11-18T21:06:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57222024-11-18T21:06:06.259ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57232024-11-18T21:06:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57242024-11-18T21:06:06.262ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57252024-11-18T21:06:06.262ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57262024-11-18T21:06:06.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57272024-11-18T21:06:06.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57282024-11-18T21:06:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57292024-11-18T21:06:06.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57302024-11-18T21:06:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57312024-11-18T21:06:06.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322024-11-18T21:06:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57332024-11-18T21:06:06.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57342024-11-18T21:06:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57352024-11-18T21:06:06.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57362024-11-18T21:06:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57372024-11-18T21:06:06.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57382024-11-18T21:06:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57392024-11-18T21:06:06.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57402024-11-18T21:06:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57412024-11-18T21:06:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57422024-11-18T21:06:06.276ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57432024-11-18T21:06:06.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 37.191677ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57442024-11-18T21:06:06.278ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57452024-11-18T21:06:06.278ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57462024-11-18T21:06:06.278ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57472024-11-18T21:06:06.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57482024-11-18T21:06:06.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57492024-11-18T21:06:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57502024-11-18T21:06:06.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57512024-11-18T21:06:06.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57522024-11-18T21:06:06.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57532024-11-18T21:06:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57542024-11-18T21:06:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57552024-11-18T21:06:06.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57562024-11-18T21:06:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57572024-11-18T21:06:06.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57582024-11-18T21:06:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57592024-11-18T21:06:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57602024-11-18T21:06:06.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57612024-11-18T21:06:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57622024-11-18T21:06:06.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57632024-11-18T21:06:06.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642024-11-18T21:06:06.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57652024-11-18T21:06:06.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57662024-11-18T21:06:06.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57672024-11-18T21:06:06.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
57682024-11-18T21:06:06.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57692024-11-18T21:06:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57702024-11-18T21:06:06.293ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57712024-11-18T21:06:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57722024-11-18T21:06:06.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57732024-11-18T21:06:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57742024-11-18T21:06:06.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57752024-11-18T21:06:06.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57762024-11-18T21:06:06.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57772024-11-18T21:06:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57782024-11-18T21:06:06.298ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57792024-11-18T21:06:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57802024-11-18T21:06:06.300ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57812024-11-18T21:06:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57822024-11-18T21:06:06.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.70128ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57832024-11-18T21:06:06.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57842024-11-18T21:06:06.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57852024-11-18T21:06:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57862024-11-18T21:06:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57872024-11-18T21:06:06.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.786006ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
57882024-11-18T21:06:06.303ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
57892024-11-18T21:06:06.303ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
57902024-11-18T21:06:06.303ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.084028ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
57912024-11-18T21:06:06.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-18T21:06:06.304ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 619058002 } })
57932024-11-18T21:06:06.304ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
57942024-11-18T21:06:06.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.603569ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57952024-11-18T21:06:06.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57962024-11-18T21:06:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57972024-11-18T21:06:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57982024-11-18T21:06:06.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57992024-11-18T21:06:06.309ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58002024-11-18T21:06:06.309ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58012024-11-18T21:06:06.309ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58022024-11-18T21:06:06.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58032024-11-18T21:06:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58042024-11-18T21:06:06.310ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
58052024-11-18T21:06:06.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.03157ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
58062024-11-18T21:06:06.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58072024-11-18T21:06:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58082024-11-18T21:06:06.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58092024-11-18T21:06:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58102024-11-18T21:06:06.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58112024-11-18T21:06:06.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58122024-11-18T21:06:06.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58132024-11-18T21:06:06.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58142024-11-18T21:06:06.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58152024-11-18T21:06:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58162024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58172024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58182024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58192024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58202024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58212024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58222024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58232024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58242024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58252024-11-18T21:06:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58262024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58272024-11-18T21:06:06.319ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58282024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.556973ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58292024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58302024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58312024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
58322024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58332024-11-18T21:06:06.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58342024-11-18T21:06:06.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58352024-11-18T21:06:06.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362024-11-18T21:06:06.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58372024-11-18T21:06:06.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58382024-11-18T21:06:06.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58392024-11-18T21:06:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58402024-11-18T21:06:06.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58412024-11-18T21:06:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58422024-11-18T21:06:06.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432024-11-18T21:06:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
58442024-11-18T21:06:06.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58452024-11-18T21:06:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58462024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58472024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58482024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58492024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58502024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58512024-11-18T21:06:06.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58522024-11-18T21:06:06.329ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58532024-11-18T21:06:06.330ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58542024-11-18T21:06:06.330ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.419115ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58552024-11-18T21:06:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58562024-11-18T21:06:06.333ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.50517ms iteration = 11 status = 0
58572024-11-18T21:06:06.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-11-18T21:06:06.336ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
58592024-11-18T21:06:06.336ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58602024-11-18T21:06:06.336ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
58612024-11-18T21:06:06.336ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 97.482688ms iteration = 6 status = {"generation":2}
58622024-11-18T21:06:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58632024-11-18T21:06:06.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58642024-11-18T21:06:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58652024-11-18T21:06:06.338ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58662024-11-18T21:06:06.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58672024-11-18T21:06:06.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.5188ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58682024-11-18T21:06:06.339ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
58692024-11-18T21:06:06.340ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58702024-11-18T21:06:06.340ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
58712024-11-18T21:06:06.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 100.722381ms iteration = 6 status = {"generation":1}
58722024-11-18T21:06:06.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58732024-11-18T21:06:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58742024-11-18T21:06:06.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752024-11-18T21:06:06.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58762024-11-18T21:06:06.343ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58772024-11-18T21:06:06.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58782024-11-18T21:06:06.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 105.89819ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58792024-11-18T21:06:06.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58802024-11-18T21:06:06.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58812024-11-18T21:06:06.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58822024-11-18T21:06:06.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58832024-11-18T21:06:06.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-11-18T21:06:06.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
58852024-11-18T21:06:06.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58862024-11-18T21:06:06.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58872024-11-18T21:06:06.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58882024-11-18T21:06:06.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58892024-11-18T21:06:06.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58902024-11-18T21:06:06.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58912024-11-18T21:06:06.374ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
58922024-11-18T21:06:06.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58932024-11-18T21:06:06.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58942024-11-18T21:06:06.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58952024-11-18T21:06:06.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58962024-11-18T21:06:06.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58972024-11-18T21:06:06.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58982024-11-18T21:06:06.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58992024-11-18T21:06:06.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59002024-11-18T21:06:06.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-11-18T21:06:06.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59022024-11-18T21:06:06.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59032024-11-18T21:06:06.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59042024-11-18T21:06:06.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59052024-11-18T21:06:06.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59062024-11-18T21:06:06.399ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
59072024-11-18T21:06:06.399ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.414546ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59082024-11-18T21:06:06.400ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
59092024-11-18T21:06:06.400ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 160.693278ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
59102024-11-18T21:06:06.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59112024-11-18T21:06:06.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59122024-11-18T21:06:06.402ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59132024-11-18T21:06:06.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59142024-11-18T21:06:06.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59152024-11-18T21:06:06.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59162024-11-18T21:06:06.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59172024-11-18T21:06:06.406ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59182024-11-18T21:06:06.406ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59192024-11-18T21:06:06.407ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "917b750b-d868-4cfe-8cc7-13c901662a50", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
59202024-11-18T21:06:06.407ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59212024-11-18T21:06:06.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59222024-11-18T21:06:06.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59232024-11-18T21:06:06.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59242024-11-18T21:06:06.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59252024-11-18T21:06:06.409ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59262024-11-18T21:06:06.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59272024-11-18T21:06:06.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282024-11-18T21:06:06.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59292024-11-18T21:06:06.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59302024-11-18T21:06:06.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59312024-11-18T21:06:06.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59322024-11-18T21:06:06.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59332024-11-18T21:06:06.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59342024-11-18T21:06:06.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59352024-11-18T21:06:06.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59362024-11-18T21:06:06.414ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.146307ms iteration = 13 status = {"physical_disks_added":0}
59372024-11-18T21:06:06.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59382024-11-18T21:06:06.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59392024-11-18T21:06:06.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59402024-11-18T21:06:06.418ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59412024-11-18T21:06:06.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59422024-11-18T21:06:06.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59432024-11-18T21:06:06.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59442024-11-18T21:06:06.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59452024-11-18T21:06:06.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59462024-11-18T21:06:06.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59472024-11-18T21:06:06.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-11-18T21:06:06.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
59492024-11-18T21:06:06.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59502024-11-18T21:06:06.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59512024-11-18T21:06:06.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59522024-11-18T21:06:06.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59532024-11-18T21:06:06.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59542024-11-18T21:06:06.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59552024-11-18T21:06:06.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59562024-11-18T21:06:06.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59572024-11-18T21:06:06.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59582024-11-18T21:06:06.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59592024-11-18T21:06:06.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59602024-11-18T21:06:06.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59612024-11-18T21:06:06.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59622024-11-18T21:06:06.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59632024-11-18T21:06:06.470ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59642024-11-18T21:06:06.470ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59652024-11-18T21:06:06.470ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6017d9e4-1b32-459c-adfc-1eaa366eb49a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
59662024-11-18T21:06:06.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59672024-11-18T21:06:06.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59682024-11-18T21:06:06.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59692024-11-18T21:06:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59702024-11-18T21:06:06.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59712024-11-18T21:06:06.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59722024-11-18T21:06:06.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59732024-11-18T21:06:06.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59742024-11-18T21:06:06.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59752024-11-18T21:06:06.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59762024-11-18T21:06:06.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59772024-11-18T21:06:06.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59782024-11-18T21:06:06.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59792024-11-18T21:06:06.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
59802024-11-18T21:06:06.491ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59812024-11-18T21:06:06.491ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd18dfa2-e1e8-4042-b71e-36501a187d67", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
59822024-11-18T21:06:06.491ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59832024-11-18T21:06:06.492ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
59842024-11-18T21:06:06.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59852024-11-18T21:06:06.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59862024-11-18T21:06:06.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59872024-11-18T21:06:06.539ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59882024-11-18T21:06:06.539ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a2a29d97-e621-496a-bcc4-c4d3a72d0166", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59892024-11-18T21:06:06.539ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59902024-11-18T21:06:06.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "331f1d10-871b-4adf-bc84-87c3adcbe1d0", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59912024-11-18T21:06:06.541ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59922024-11-18T21:06:06.542ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59932024-11-18T21:06:06.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 303.526864ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59942024-11-18T21:06:06.648ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59952024-11-18T21:06:06.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59962024-11-18T21:06:06.652ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 413.107081ms iteration = 11 status = {}
59972024-11-18T21:06:06.709ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59982024-11-18T21:06:06.710ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59992024-11-18T21:06:06.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60002024-11-18T21:06:06.711ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "034b2218-e5f3-433f-bc9d-2d5bc09daddd", "content-length": "1", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
60012024-11-18T21:06:06.712ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60022024-11-18T21:06:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60032024-11-18T21:06:06.715ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 476.412553ms iteration = 11 status = null
60042024-11-18T21:06:06.716ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
60052024-11-18T21:06:06.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60062024-11-18T21:06:06.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60072024-11-18T21:06:06.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc8ed7a1-9b96-471b-ab0c-f438c52d22ba", "content-length": "691", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60082024-11-18T21:06:06.716ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60092024-11-18T21:06:06.716ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60102024-11-18T21:06:06.716ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60112024-11-18T21:06:06.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fdad7e9-f4ee-4993-b232-217211ba3d4f", "content-length": "372", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60122024-11-18T21:06:06.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60132024-11-18T21:06:06.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60142024-11-18T21:06:06.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60152024-11-18T21:06:06.718ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 479.071213ms iteration = 11 status = {}
60162024-11-18T21:06:06.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
60172024-11-18T21:06:06.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60182024-11-18T21:06:06.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60192024-11-18T21:06:06.723ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
60202024-11-18T21:06:06.723ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
60212024-11-18T21:06:06.723ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
60222024-11-18T21:06:06.731ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60232024-11-18T21:06:06.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60242024-11-18T21:06:06.731ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de29bb4d-90d1-4f9a-b1a4-99458f487bec", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60252024-11-18T21:06:06.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60262024-11-18T21:06:06.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60272024-11-18T21:06:06.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60282024-11-18T21:06:06.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60292024-11-18T21:06:06.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60302024-11-18T21:06:06.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60312024-11-18T21:06:06.740ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60322024-11-18T21:06:06.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60332024-11-18T21:06:06.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b57634c6-c1cd-4f1a-bd84-99d04945e1a1", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60342024-11-18T21:06:06.742ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 502.79058ms iteration = 11 status = {}
60352024-11-18T21:06:06.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60362024-11-18T21:06:06.753ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29b227aa-9166-4c5b-a848-71fd5bc53e8b", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60372024-11-18T21:06:06.753ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60382024-11-18T21:06:06.755ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c34cf884-d15c-481c-af2b-ea6edb849258", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60392024-11-18T21:06:06.755ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60402024-11-18T21:06:06.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "99c8be9a-0d53-4622-a6d6-bc6acc5f415c", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60412024-11-18T21:06:06.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60422024-11-18T21:06:06.759ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60432024-11-18T21:06:06.759ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.32469ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60442024-11-18T21:06:06.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64378a4c-58e8-445c-ad33-dfdc4d74c08a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
60452024-11-18T21:06:06.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64378a4c-58e8-445c-ad33-dfdc4d74c08a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
60462024-11-18T21:06:06.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60472024-11-18T21:06:06.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64378a4c-58e8-445c-ad33-dfdc4d74c08a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
60482024-11-18T21:06:06.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60492024-11-18T21:06:06.774ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
60502024-11-18T21:06:06.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60512024-11-18T21:06:06.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60522024-11-18T21:06:06.784ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60532024-11-18T21:06:06.784ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d956b6d-9600-407a-8b1b-74dd88f0d802", "content-length": "134", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
60542024-11-18T21:06:06.784ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60552024-11-18T21:06:06.784ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
60562024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60572024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60582024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60592024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60602024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60612024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60622024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60632024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60642024-11-18T21:06:06.785ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
60652024-11-18T21:06:06.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60662024-11-18T21:06:06.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60672024-11-18T21:06:06.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60682024-11-18T21:06:06.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f054d651-5281-4e15-9e30-2d5cee84208e", "content-length": "2", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
60692024-11-18T21:06:06.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60702024-11-18T21:06:06.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee36517c-7393-4bdb-b686-4ff902a8c1e0", "content-length": "51", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
60712024-11-18T21:06:06.788ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
60722024-11-18T21:06:06.788ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60732024-11-18T21:06:06.825ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 79cbda5a-2e27-489e-945d-860d86dec819, time_created: 2024-11-18T21:01:57.213298Z, time_modified: 2024-11-18T21:01:57.213298Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
60742024-11-18T21:06:06.825ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
60752024-11-18T21:06:06.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60762024-11-18T21:06:06.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60772024-11-18T21:06:06.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60782024-11-18T21:06:06.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60792024-11-18T21:06:06.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60802024-11-18T21:06:06.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
60812024-11-18T21:06:06.866ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
60822024-11-18T21:06:06.875ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "95ca482f-4e99-487a-9215-dd4ad5047c47", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60832024-11-18T21:06:06.875ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
60842024-11-18T21:06:06.875ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60852024-11-18T21:06:06.875ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad94c9a6-de60-4c94-9bcd-167fa16bcdb2", "content-length": "682", "date": "Mon, 18 Nov 2024 21:06:06 GMT"} })
60862024-11-18T21:06:06.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60872024-11-18T21:06:06.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60882024-11-18T21:06:06.876ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6b6037bf-e605-4279-ae43-2fee52f8513f", "date": "Mon, 18 Nov 2024 21:06:05 GMT"} })
60892024-11-18T21:06:06.878ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
60902024-11-18T21:06:06.878ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 638.798624ms
60912024-11-18T21:06:06.878ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 638.806634ms iteration = 2 status = {}
60922024-11-18T21:06:06.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60932024-11-18T21:06:06.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60942024-11-18T21:06:06.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952024-11-18T21:06:06.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60962024-11-18T21:06:06.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60972024-11-18T21:06:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60982024-11-18T21:06:06.893ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 654.555712ms iteration = 11 status = {}
60992024-11-18T21:06:07.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482b9315-dba1-43da-b177-97b73e3f1f21 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61002024-11-18T21:06:07.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482b9315-dba1-43da-b177-97b73e3f1f21 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61012024-11-18T21:06:07.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482b9315-dba1-43da-b177-97b73e3f1f21 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61022024-11-18T21:06:08.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53236f3-53f8-41c9-9fbd-ced6d176443f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61032024-11-18T21:06:08.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53236f3-53f8-41c9-9fbd-ced6d176443f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61042024-11-18T21:06:08.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53236f3-53f8-41c9-9fbd-ced6d176443f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61052024-11-18T21:06:09.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 592e2010-0ac3-41af-bb8e-9f7bfb335b83 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61062024-11-18T21:06:09.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 592e2010-0ac3-41af-bb8e-9f7bfb335b83 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61072024-11-18T21:06:09.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 592e2010-0ac3-41af-bb8e-9f7bfb335b83 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61082024-11-18T21:06:10.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 7ca11e28-d8f0-4fd9-b0a0-230e1e0f9dde roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
61092024-11-18T21:06:10.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 7ca11e28-d8f0-4fd9-b0a0-230e1e0f9dde resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
61102024-11-18T21:06:10.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 7ca11e28-d8f0-4fd9-b0a0-230e1e0f9dde response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
61112024-11-18T21:06:10.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6161fbc1-7bfa-4bb6-a0f9-3961b7c1a20a roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
61122024-11-18T21:06:10.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6161fbc1-7bfa-4bb6-a0f9-3961b7c1a20a resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
61132024-11-18T21:06:10.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 6161fbc1-7bfa-4bb6-a0f9-3961b7c1a20a response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
61142024-11-18T21:06:10.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f70117cb-b207-438e-ad84-556db0fe6a72 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61152024-11-18T21:06:10.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f70117cb-b207-438e-ad84-556db0fe6a72 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61162024-11-18T21:06:10.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f70117cb-b207-438e-ad84-556db0fe6a72 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61172024-11-18T21:06:11.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a612e091-d3b5-488c-bd5b-37c8e0672744 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61182024-11-18T21:06:11.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a612e091-d3b5-488c-bd5b-37c8e0672744 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61192024-11-18T21:06:11.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a612e091-d3b5-488c-bd5b-37c8e0672744 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61202024-11-18T21:06:12.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41ab13ee-4930-46f6-a4da-22fe828a1006 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61212024-11-18T21:06:12.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41ab13ee-4930-46f6-a4da-22fe828a1006 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61222024-11-18T21:06:12.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41ab13ee-4930-46f6-a4da-22fe828a1006 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61232024-11-18T21:06:14.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6673a5d2-0d34-45aa-855d-f22bdba07572 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61242024-11-18T21:06:14.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6673a5d2-0d34-45aa-855d-f22bdba07572 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61252024-11-18T21:06:14.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6673a5d2-0d34-45aa-855d-f22bdba07572 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61262024-11-18T21:06:15.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 283d8608-318d-41b0-aacd-33925cafb5a8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61272024-11-18T21:06:15.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 283d8608-318d-41b0-aacd-33925cafb5a8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61282024-11-18T21:06:15.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 283d8608-318d-41b0-aacd-33925cafb5a8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61292024-11-18T21:06:16.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7490d6e7-9297-4713-b75c-12a32d741245 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61302024-11-18T21:06:16.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7490d6e7-9297-4713-b75c-12a32d741245 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61312024-11-18T21:06:16.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7490d6e7-9297-4713-b75c-12a32d741245 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61322024-11-18T21:06:16.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
61332024-11-18T21:06:16.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
61342024-11-18T21:06:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61352024-11-18T21:06:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362024-11-18T21:06:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61372024-11-18T21:06:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61382024-11-18T21:06:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392024-11-18T21:06:16.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61402024-11-18T21:06:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61412024-11-18T21:06:16.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.96598ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61422024-11-18T21:06:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61432024-11-18T21:06:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61442024-11-18T21:06:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452024-11-18T21:06:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61462024-11-18T21:06:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61472024-11-18T21:06:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482024-11-18T21:06:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
61492024-11-18T21:06:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61502024-11-18T21:06:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61512024-11-18T21:06:16.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
61522024-11-18T21:06:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.899419ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
61532024-11-18T21:06:17.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5001f06d-b847-441a-8d83-4143a9efead7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61542024-11-18T21:06:17.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5001f06d-b847-441a-8d83-4143a9efead7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61552024-11-18T21:06:17.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5001f06d-b847-441a-8d83-4143a9efead7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61562024-11-18T21:06:18.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d0e0acd-1116-4c98-adb3-7a5c78000cd3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61572024-11-18T21:06:18.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d0e0acd-1116-4c98-adb3-7a5c78000cd3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61582024-11-18T21:06:18.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6d0e0acd-1116-4c98-adb3-7a5c78000cd3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61592024-11-18T21:06:19.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82d9d6e8-5837-4734-8759-5fb7f82e406f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61602024-11-18T21:06:19.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82d9d6e8-5837-4734-8759-5fb7f82e406f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61612024-11-18T21:06:19.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82d9d6e8-5837-4734-8759-5fb7f82e406f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61622024-11-18T21:06:20.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9311af2d-eb6a-4231-990b-76bd3091172c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61632024-11-18T21:06:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9311af2d-eb6a-4231-990b-76bd3091172c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61642024-11-18T21:06:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9311af2d-eb6a-4231-990b-76bd3091172c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61652024-11-18T21:06:20.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 663bc0f2-ed44-45c6-ace1-8e6bdd5e389a response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
61662024-11-18T21:06:21.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df6ac706-cf9f-442e-9a63-a3213772cbfa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61672024-11-18T21:06:21.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df6ac706-cf9f-442e-9a63-a3213772cbfa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61682024-11-18T21:06:21.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = df6ac706-cf9f-442e-9a63-a3213772cbfa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61692024-11-18T21:06:22.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2be8c8bf-0d1c-4690-941b-f9814e5a0afd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61702024-11-18T21:06:22.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2be8c8bf-0d1c-4690-941b-f9814e5a0afd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61712024-11-18T21:06:22.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2be8c8bf-0d1c-4690-941b-f9814e5a0afd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61722024-11-18T21:06:23.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f8b7a72-2c69-4279-8589-948a1320fdef roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61732024-11-18T21:06:23.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f8b7a72-2c69-4279-8589-948a1320fdef resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61742024-11-18T21:06:23.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f8b7a72-2c69-4279-8589-948a1320fdef response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61752024-11-18T21:06:24.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39e7924-327d-43e9-af83-9beb573f98ff roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61762024-11-18T21:06:24.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39e7924-327d-43e9-af83-9beb573f98ff resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61772024-11-18T21:06:24.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39e7924-327d-43e9-af83-9beb573f98ff response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61782024-11-18T21:06:25.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7729b642-fe91-43a4-8076-12d0318b72e1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61792024-11-18T21:06:25.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7729b642-fe91-43a4-8076-12d0318b72e1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61802024-11-18T21:06:25.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7729b642-fe91-43a4-8076-12d0318b72e1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
61812024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
61822024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61832024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
61842024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61852024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61862024-11-18T21:06:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61872024-11-18T21:06:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61882024-11-18T21:06:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61892024-11-18T21:06:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61902024-11-18T21:06:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.398002ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61912024-11-18T21:06:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61922024-11-18T21:06:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61932024-11-18T21:06:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61942024-11-18T21:06:26.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61952024-11-18T21:06:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61962024-11-18T21:06:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61972024-11-18T21:06:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
61982024-11-18T21:06:26.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61992024-11-18T21:06:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62002024-11-18T21:06:26.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
62012024-11-18T21:06:26.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.173513ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
62022024-11-18T21:06:26.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = acd12dd0-2521-4e29-8adf-b92edf07f9b2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62032024-11-18T21:06:26.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = acd12dd0-2521-4e29-8adf-b92edf07f9b2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62042024-11-18T21:06:26.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = acd12dd0-2521-4e29-8adf-b92edf07f9b2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62052024-11-18T21:06:27.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90ec576e-deae-41b3-b86a-3abdd36f1105 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62062024-11-18T21:06:27.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90ec576e-deae-41b3-b86a-3abdd36f1105 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62072024-11-18T21:06:27.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90ec576e-deae-41b3-b86a-3abdd36f1105 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62082024-11-18T21:06:28.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 047a441a-6a72-4661-b536-4fa71fec4afa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62092024-11-18T21:06:28.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 047a441a-6a72-4661-b536-4fa71fec4afa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62102024-11-18T21:06:28.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 047a441a-6a72-4661-b536-4fa71fec4afa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62112024-11-18T21:06:29.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94701590-e7fb-4dde-a368-fca00e711070 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62122024-11-18T21:06:29.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94701590-e7fb-4dde-a368-fca00e711070 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62132024-11-18T21:06:29.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94701590-e7fb-4dde-a368-fca00e711070 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62142024-11-18T21:06:30.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cf553f2-2375-40b4-97c5-0bee7d69b551 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62152024-11-18T21:06:30.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cf553f2-2375-40b4-97c5-0bee7d69b551 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62162024-11-18T21:06:30.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0cf553f2-2375-40b4-97c5-0bee7d69b551 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62172024-11-18T21:06:31.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c512727-62c3-402a-b3fd-b71a642b2eb6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62182024-11-18T21:06:31.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c512727-62c3-402a-b3fd-b71a642b2eb6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62192024-11-18T21:06:31.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3c512727-62c3-402a-b3fd-b71a642b2eb6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62202024-11-18T21:06:32.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa854ccb-9d6e-4d87-9628-34913c553133 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62212024-11-18T21:06:32.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa854ccb-9d6e-4d87-9628-34913c553133 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62222024-11-18T21:06:32.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa854ccb-9d6e-4d87-9628-34913c553133 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62232024-11-18T21:06:33.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e588593-6762-4eb8-8fea-825051d004ae roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62242024-11-18T21:06:33.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e588593-6762-4eb8-8fea-825051d004ae resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62252024-11-18T21:06:33.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4e588593-6762-4eb8-8fea-825051d004ae response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62262024-11-18T21:06:34.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a55a15b8-e5a9-41ec-95e2-35ee7ba67e33 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62272024-11-18T21:06:34.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a55a15b8-e5a9-41ec-95e2-35ee7ba67e33 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62282024-11-18T21:06:34.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a55a15b8-e5a9-41ec-95e2-35ee7ba67e33 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62292024-11-18T21:06:35.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 453c37f3-107d-404a-9d4f-31a43d1fae9f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62302024-11-18T21:06:35.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 453c37f3-107d-404a-9d4f-31a43d1fae9f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62312024-11-18T21:06:35.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 453c37f3-107d-404a-9d4f-31a43d1fae9f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
62322024-11-18T21:06:35.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 07d69304-1b3f-40f9-8514-9ae77e820d5b response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
62332024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
62342024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62352024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
62362024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62372024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62382024-11-18T21:06:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62392024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
62402024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
62412024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
62422024-11-18T21:06:36.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62432024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62442024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62452024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62462024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
62472024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62482024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
62492024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
62502024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62512024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62522024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
62532024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62542024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
62552024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62562024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
62572024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62582024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
62592024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62602024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
62612024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
62622024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
62632024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62642024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62652024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
62662024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
62672024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62682024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62692024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62702024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62712024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62722024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62732024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62742024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62752024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62762024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62772024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62782024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62792024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62802024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62812024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62822024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62832024-11-18T21:06:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62842024-11-18T21:06:36.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 556166383 } })
62852024-11-18T21:06:36.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
62862024-11-18T21:06:36.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 556719687 } })
62872024-11-18T21:06:36.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
62882024-11-18T21:06:36.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62892024-11-18T21:06:36.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.265335ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62902024-11-18T21:06:36.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62912024-11-18T21:06:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62922024-11-18T21:06:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62932024-11-18T21:06:36.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62942024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62952024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62962024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62972024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62982024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62992024-11-18T21:06:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63002024-11-18T21:06:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63012024-11-18T21:06:36.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63022024-11-18T21:06:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63032024-11-18T21:06:36.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-11-18T21:06:36.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63052024-11-18T21:06:36.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.450721ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
63062024-11-18T21:06:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63072024-11-18T21:06:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63082024-11-18T21:06:36.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63092024-11-18T21:06:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63102024-11-18T21:06:36.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63112024-11-18T21:06:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63122024-11-18T21:06:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63132024-11-18T21:06:36.252ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63142024-11-18T21:06:36.252ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63152024-11-18T21:06:36.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63162024-11-18T21:06:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63172024-11-18T21:06:36.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.603231ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63182024-11-18T21:06:36.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63192024-11-18T21:06:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63202024-11-18T21:06:36.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1305, tv_nsec: 569246261 } })
63212024-11-18T21:06:36.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-11-18T21:06:36.255ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
63232024-11-18T21:06:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63242024-11-18T21:06:36.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63252024-11-18T21:06:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63262024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63272024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63282024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63292024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63302024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63312024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63322024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63332024-11-18T21:06:36.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.782192ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63342024-11-18T21:06:36.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63352024-11-18T21:06:36.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63362024-11-18T21:06:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63372024-11-18T21:06:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63382024-11-18T21:06:36.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 19.260504ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63392024-11-18T21:06:36.260ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63402024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63412024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63422024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63432024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63442024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63452024-11-18T21:06:36.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-11-18T21:06:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63472024-11-18T21:06:36.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63482024-11-18T21:06:36.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63492024-11-18T21:06:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63502024-11-18T21:06:36.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
63512024-11-18T21:06:36.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63522024-11-18T21:06:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63532024-11-18T21:06:36.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 34.742639ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
63542024-11-18T21:06:36.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
63552024-11-18T21:06:36.276ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.733717ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
63562024-11-18T21:06:36.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63572024-11-18T21:06:36.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63582024-11-18T21:06:36.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63592024-11-18T21:06:36.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63602024-11-18T21:06:36.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612024-11-18T21:06:36.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 48.759594ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63622024-11-18T21:06:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63632024-11-18T21:06:36.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63642024-11-18T21:06:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63652024-11-18T21:06:36.291ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63662024-11-18T21:06:36.291ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63672024-11-18T21:06:36.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.97231ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63682024-11-18T21:06:36.295ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.726795ms iteration = 14 status = {"physical_disks_added":0}
63692024-11-18T21:06:36.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63702024-11-18T21:06:36.326ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63712024-11-18T21:06:36.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63722024-11-18T21:06:36.326ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5623052d-56e3-47d4-9da1-7bf330b71cc6", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
63732024-11-18T21:06:36.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63742024-11-18T21:06:36.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63752024-11-18T21:06:36.327ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63762024-11-18T21:06:36.327ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63772024-11-18T21:06:36.327ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "315e7d2d-01ea-497d-a874-9ec9114c562c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
63782024-11-18T21:06:36.327ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63792024-11-18T21:06:36.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63802024-11-18T21:06:36.329ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63812024-11-18T21:06:36.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
63822024-11-18T21:06:36.346ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63832024-11-18T21:06:36.346ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dee0894-8531-4d08-9ebd-5a73e3933a76", "content-length": "26", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
63842024-11-18T21:06:36.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63852024-11-18T21:06:36.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
63862024-11-18T21:06:36.352ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63872024-11-18T21:06:36.352ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63882024-11-18T21:06:36.352ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "988ba860-4963-49fc-ab61-7a174387c6ab", "content-length": "372", "date": "Mon, 18 Nov 2024 21:06:35 GMT"} })
63892024-11-18T21:06:36.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63902024-11-18T21:06:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63912024-11-18T21:06:36.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-11-18T21:06:36.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63932024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63942024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63952024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
63962024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63972024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63982024-11-18T21:06:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63992024-11-18T21:06:36.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64002024-11-18T21:06:36.360ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.002606ms iteration = 12 status = 0
64012024-11-18T21:06:36.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64022024-11-18T21:06:36.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64032024-11-18T21:06:36.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64042024-11-18T21:06:36.366ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64052024-11-18T21:06:36.366ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64062024-11-18T21:06:36.366ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "06ebff77-220d-4bae-a6b3-c0fbc82e3e3e", "date": "Mon, 18 Nov 2024 21:06:35 GMT"} })
64072024-11-18T21:06:36.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64082024-11-18T21:06:36.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64092024-11-18T21:06:36.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64102024-11-18T21:06:36.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64112024-11-18T21:06:36.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64122024-11-18T21:06:36.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64132024-11-18T21:06:36.375ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64142024-11-18T21:06:36.375ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64152024-11-18T21:06:36.375ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0026d567-0b73-41ec-90a3-39869d6365dc", "date": "Mon, 18 Nov 2024 21:06:35 GMT"} })
64162024-11-18T21:06:36.377ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 137.310305ms iteration = 12 status = {}
64172024-11-18T21:06:36.384ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64182024-11-18T21:06:36.384ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.611988ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64192024-11-18T21:06:36.408ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.040841ms iteration = 12 status = {}
64202024-11-18T21:06:36.420ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64212024-11-18T21:06:36.420ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2441002a-f2df-46a7-b870-c8463402b2ec", "content-length": "1", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
64222024-11-18T21:06:36.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64232024-11-18T21:06:36.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64242024-11-18T21:06:36.423ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 184.845919ms iteration = 12 status = null
64252024-11-18T21:06:36.486ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64262024-11-18T21:06:36.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64272024-11-18T21:06:36.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64282024-11-18T21:06:36.516ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
64292024-11-18T21:06:36.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64302024-11-18T21:06:36.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64312024-11-18T21:06:36.527ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64322024-11-18T21:06:36.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba324b1a-0be8-4e2c-a3b1-126d82db8c3b", "content-length": "134", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
64332024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64342024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
64352024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64362024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64372024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64382024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64392024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64402024-11-18T21:06:36.527ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64412024-11-18T21:06:36.528ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64422024-11-18T21:06:36.528ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64432024-11-18T21:06:36.528ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
64442024-11-18T21:06:36.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64452024-11-18T21:06:36.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64462024-11-18T21:06:36.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64472024-11-18T21:06:36.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "55f6f904-27da-4293-a1e5-1d6f7948f3c3", "content-length": "2", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
64482024-11-18T21:06:36.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64492024-11-18T21:06:36.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3339d2a-e020-4960-8f79-1e3de4ab8050", "content-length": "51", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
64502024-11-18T21:06:36.530ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
64512024-11-18T21:06:36.530ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64522024-11-18T21:06:36.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38bd1e4c-f77b-4580-9db8-3afffe9d4720 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64532024-11-18T21:06:36.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38bd1e4c-f77b-4580-9db8-3afffe9d4720 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64542024-11-18T21:06:36.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c80e32c6-4820-4469-a97a-53ff07b3365c", "content-length": "691", "date": "Mon, 18 Nov 2024 21:06:36 GMT"} })
64552024-11-18T21:06:36.552ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64562024-11-18T21:06:36.552ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64572024-11-18T21:06:36.552ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64582024-11-18T21:06:36.553ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 313.529469ms iteration = 12 status = {}
64592024-11-18T21:06:36.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38bd1e4c-f77b-4580-9db8-3afffe9d4720 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64602024-11-18T21:06:36.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7fe4b251-9915-4784-84e7-ad4d8243f3e1", "date": "Mon, 18 Nov 2024 21:06:35 GMT"} })
64612024-11-18T21:06:36.643ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
64622024-11-18T21:06:36.643ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64632024-11-18T21:06:36.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2dddbc5-72f1-4f1c-bcee-2a78699fb9d1", "content-length": "682", "date": "Mon, 18 Nov 2024 21:06:35 GMT"} })
64642024-11-18T21:06:36.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64652024-11-18T21:06:36.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64662024-11-18T21:06:36.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64672024-11-18T21:06:36.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64682024-11-18T21:06:36.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64692024-11-18T21:06:36.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64702024-11-18T21:06:36.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64712024-11-18T21:06:36.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64722024-11-18T21:06:36.658ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 418.813174ms iteration = 12 status = {}
64732024-11-18T21:06:37.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 082a62e7-8f37-4458-a775-44fac69415f6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64742024-11-18T21:06:37.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 082a62e7-8f37-4458-a775-44fac69415f6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64752024-11-18T21:06:37.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 082a62e7-8f37-4458-a775-44fac69415f6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64762024-11-18T21:06:38.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e0738ed-aa01-4ae4-a721-957fd57d82a8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64772024-11-18T21:06:38.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e0738ed-aa01-4ae4-a721-957fd57d82a8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64782024-11-18T21:06:38.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e0738ed-aa01-4ae4-a721-957fd57d82a8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64792024-11-18T21:06:39.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d8f01945-df5b-4c80-a1d2-d0ec2f069732 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64802024-11-18T21:06:39.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d8f01945-df5b-4c80-a1d2-d0ec2f069732 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64812024-11-18T21:06:39.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d8f01945-df5b-4c80-a1d2-d0ec2f069732 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64822024-11-18T21:06:40.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb39fc62-f61a-471e-955b-db62f529017c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64832024-11-18T21:06:40.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb39fc62-f61a-471e-955b-db62f529017c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64842024-11-18T21:06:40.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb39fc62-f61a-471e-955b-db62f529017c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64852024-11-18T21:06:40.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 941a562d-2658-4d0c-8f68-dab2c887887c roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
64862024-11-18T21:06:40.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 941a562d-2658-4d0c-8f68-dab2c887887c resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
64872024-11-18T21:06:40.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 941a562d-2658-4d0c-8f68-dab2c887887c response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
64882024-11-18T21:06:40.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 14fa27d6-97a5-4a71-b7d7-93a83c6320be roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
64892024-11-18T21:06:40.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 14fa27d6-97a5-4a71-b7d7-93a83c6320be resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
64902024-11-18T21:06:40.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41801 req_id = 14fa27d6-97a5-4a71-b7d7-93a83c6320be response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
64912024-11-18T21:06:41.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff802b94-6591-4232-b746-7ffae3bbdbd0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64922024-11-18T21:06:41.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff802b94-6591-4232-b746-7ffae3bbdbd0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64932024-11-18T21:06:41.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ff802b94-6591-4232-b746-7ffae3bbdbd0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64942024-11-18T21:06:42.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1b1604a-8109-4ad5-a85f-283c313e73ba roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64952024-11-18T21:06:42.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1b1604a-8109-4ad5-a85f-283c313e73ba resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64962024-11-18T21:06:42.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d1b1604a-8109-4ad5-a85f-283c313e73ba response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64972024-11-18T21:06:43.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d88f3cd5-aa59-494c-9389-1884ff5a2fa1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64982024-11-18T21:06:43.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d88f3cd5-aa59-494c-9389-1884ff5a2fa1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
64992024-11-18T21:06:43.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d88f3cd5-aa59-494c-9389-1884ff5a2fa1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65002024-11-18T21:06:44.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96980266-50f6-4524-a7b1-6c6e15d524a6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65012024-11-18T21:06:44.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96980266-50f6-4524-a7b1-6c6e15d524a6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65022024-11-18T21:06:44.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96980266-50f6-4524-a7b1-6c6e15d524a6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65032024-11-18T21:06:45.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064d51ef-cceb-4913-9abb-caaa8758b90a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65042024-11-18T21:06:45.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064d51ef-cceb-4913-9abb-caaa8758b90a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65052024-11-18T21:06:45.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 064d51ef-cceb-4913-9abb-caaa8758b90a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65062024-11-18T21:06:46.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
65072024-11-18T21:06:46.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65082024-11-18T21:06:46.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
65092024-11-18T21:06:46.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65102024-11-18T21:06:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65112024-11-18T21:06:46.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65122024-11-18T21:06:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65132024-11-18T21:06:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65142024-11-18T21:06:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65152024-11-18T21:06:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65162024-11-18T21:06:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65172024-11-18T21:06:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65182024-11-18T21:06:46.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65192024-11-18T21:06:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
65202024-11-18T21:06:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65212024-11-18T21:06:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65222024-11-18T21:06:46.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
65232024-11-18T21:06:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.77467ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
65242024-11-18T21:06:46.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65252024-11-18T21:06:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65262024-11-18T21:06:46.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.099629ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65272024-11-18T21:06:46.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6cdfae13-e43c-4196-a89f-9d99df069e84 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65282024-11-18T21:06:46.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6cdfae13-e43c-4196-a89f-9d99df069e84 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65292024-11-18T21:06:46.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6cdfae13-e43c-4196-a89f-9d99df069e84 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65302024-11-18T21:06:47.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c9f9c64-3c5a-45f5-baf1-1b6d57c51d71 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65312024-11-18T21:06:47.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c9f9c64-3c5a-45f5-baf1-1b6d57c51d71 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65322024-11-18T21:06:47.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c9f9c64-3c5a-45f5-baf1-1b6d57c51d71 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65332024-11-18T21:06:48.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 34da6573-4500-46f4-990f-3496ed781420 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65342024-11-18T21:06:48.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 34da6573-4500-46f4-990f-3496ed781420 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65352024-11-18T21:06:48.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 34da6573-4500-46f4-990f-3496ed781420 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65362024-11-18T21:06:49.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8caccb67-8e6f-4e9c-b9df-5ddfa2c75522 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65372024-11-18T21:06:49.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8caccb67-8e6f-4e9c-b9df-5ddfa2c75522 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65382024-11-18T21:06:49.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8caccb67-8e6f-4e9c-b9df-5ddfa2c75522 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65392024-11-18T21:06:50.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 469a2ba7-15a9-48af-871d-846df315f374 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65402024-11-18T21:06:50.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 469a2ba7-15a9-48af-871d-846df315f374 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65412024-11-18T21:06:50.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 469a2ba7-15a9-48af-871d-846df315f374 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65422024-11-18T21:06:50.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 656 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 462713c2-d8c4-406c-9ea1-45f7ed1dac88 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
65432024-11-18T21:06:51.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e56e4fe-cf1f-4c02-aa26-619e2ec6dc5f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65442024-11-18T21:06:51.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e56e4fe-cf1f-4c02-aa26-619e2ec6dc5f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65452024-11-18T21:06:51.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e56e4fe-cf1f-4c02-aa26-619e2ec6dc5f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65462024-11-18T21:06:52.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33db023f-3c2c-484c-a225-8ed83ac3564f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65472024-11-18T21:06:52.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33db023f-3c2c-484c-a225-8ed83ac3564f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65482024-11-18T21:06:52.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33db023f-3c2c-484c-a225-8ed83ac3564f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65492024-11-18T21:06:53.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 902df951-2619-4484-9c7e-915422d5c0b5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65502024-11-18T21:06:53.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 902df951-2619-4484-9c7e-915422d5c0b5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65512024-11-18T21:06:53.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 902df951-2619-4484-9c7e-915422d5c0b5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65522024-11-18T21:06:54.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4f0dc49-c1a4-4c69-bc38-b337fc8286e9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65532024-11-18T21:06:54.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4f0dc49-c1a4-4c69-bc38-b337fc8286e9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65542024-11-18T21:06:54.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4f0dc49-c1a4-4c69-bc38-b337fc8286e9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65552024-11-18T21:06:55.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b08881d9-0607-40ec-927e-02295dc1a85d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65562024-11-18T21:06:55.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b08881d9-0607-40ec-927e-02295dc1a85d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65572024-11-18T21:06:55.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b08881d9-0607-40ec-927e-02295dc1a85d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65582024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
65592024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
65602024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65612024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65622024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65632024-11-18T21:06:56.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65642024-11-18T21:06:56.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65652024-11-18T21:06:56.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65662024-11-18T21:06:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65672024-11-18T21:06:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65682024-11-18T21:06:56.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-11-18T21:06:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702024-11-18T21:06:56.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65712024-11-18T21:06:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65722024-11-18T21:06:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732024-11-18T21:06:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
65742024-11-18T21:06:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65752024-11-18T21:06:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65762024-11-18T21:06:56.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
65772024-11-18T21:06:56.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.839076ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
65782024-11-18T21:06:56.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.81564ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65792024-11-18T21:06:57.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d34f4125-2e3c-46b0-a224-2e51ff7c8628 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65802024-11-18T21:06:57.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d34f4125-2e3c-46b0-a224-2e51ff7c8628 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65812024-11-18T21:06:57.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d34f4125-2e3c-46b0-a224-2e51ff7c8628 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65822024-11-18T21:06:58.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ebc35a5-5b66-45fb-bd6b-4445efb9ddac roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65832024-11-18T21:06:58.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ebc35a5-5b66-45fb-bd6b-4445efb9ddac resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65842024-11-18T21:06:58.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5ebc35a5-5b66-45fb-bd6b-4445efb9ddac response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65852024-11-18T21:06:59.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1908b5ad-005e-46f0-bdff-dcb38aa22b63 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65862024-11-18T21:06:59.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1908b5ad-005e-46f0-bdff-dcb38aa22b63 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65872024-11-18T21:06:59.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1908b5ad-005e-46f0-bdff-dcb38aa22b63 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65882024-11-18T21:07:00.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08d3a521-bf7a-4af4-830a-c00f54fb6de9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65892024-11-18T21:07:00.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08d3a521-bf7a-4af4-830a-c00f54fb6de9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65902024-11-18T21:07:00.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08d3a521-bf7a-4af4-830a-c00f54fb6de9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65912024-11-18T21:07:01.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f35f343d-a642-4fe8-8bf8-dd8314747d02 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65922024-11-18T21:07:01.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f35f343d-a642-4fe8-8bf8-dd8314747d02 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65932024-11-18T21:07:01.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f35f343d-a642-4fe8-8bf8-dd8314747d02 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65942024-11-18T21:07:02.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb5a6eb7-3087-447f-a2fb-22483971bdfb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65952024-11-18T21:07:02.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb5a6eb7-3087-447f-a2fb-22483971bdfb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65962024-11-18T21:07:02.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cb5a6eb7-3087-447f-a2fb-22483971bdfb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65972024-11-18T21:07:03.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97272ae2-0771-4c04-ac52-4c2347db5d01 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65982024-11-18T21:07:03.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97272ae2-0771-4c04-ac52-4c2347db5d01 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
65992024-11-18T21:07:03.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97272ae2-0771-4c04-ac52-4c2347db5d01 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66002024-11-18T21:07:04.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5475781-cbd8-49fe-85d7-aa1536c24b5c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66012024-11-18T21:07:04.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5475781-cbd8-49fe-85d7-aa1536c24b5c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66022024-11-18T21:07:04.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5475781-cbd8-49fe-85d7-aa1536c24b5c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66032024-11-18T21:07:05.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adf65fad-abc0-4518-ad09-593803b5bb4e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66042024-11-18T21:07:05.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adf65fad-abc0-4518-ad09-593803b5bb4e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66052024-11-18T21:07:05.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adf65fad-abc0-4518-ad09-593803b5bb4e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66062024-11-18T21:07:05.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = e6cf9d2b-e061-406c-bf71-0ed224c85865 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
66072024-11-18T21:07:06.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03f0353-c408-43c4-a7ff-aa1b6ed9fd4c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66082024-11-18T21:07:06.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03f0353-c408-43c4-a7ff-aa1b6ed9fd4c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66092024-11-18T21:07:06.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03f0353-c408-43c4-a7ff-aa1b6ed9fd4c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
66102024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
66112024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
66122024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66132024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
66142024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66152024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66162024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
66172024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66182024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
66192024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
66202024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66212024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
66222024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66232024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
66242024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
66252024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66262024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
66272024-11-18T21:07:06.239ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:57:06.239785640 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66282024-11-18T21:07:06.239ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66292024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66302024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66312024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66322024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66332024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66342024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
66352024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66362024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
66372024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
66382024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66392024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66402024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66412024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
66422024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66432024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
66442024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66452024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
66462024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66472024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
66482024-11-18T21:07:06.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66492024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66502024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
66512024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66522024-11-18T21:07:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 554326189 } })
66532024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
66542024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66552024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
66562024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66572024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
66582024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
66592024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
66602024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66612024-11-18T21:07:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 554398500 } })
66622024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66632024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
66642024-11-18T21:07:06.240ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
66652024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66662024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.48\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
66672024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
66682024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
66692024-11-18T21:07:06.240ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66702024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66712024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
66722024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66732024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66742024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
66752024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
66762024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66772024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
66782024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66792024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66802024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
66812024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66822024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66832024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66842024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66852024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66862024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66872024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66882024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66892024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66902024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66912024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66922024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66932024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66942024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66952024-11-18T21:07:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66962024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
66972024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66982024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66992024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67002024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
67012024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67022024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67032024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.34654ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
67042024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
67052024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67062024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.3857ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
67072024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67082024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67092024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67102024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67112024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67122024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67132024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67142024-11-18T21:07:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67152024-11-18T21:07:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67162024-11-18T21:07:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67172024-11-18T21:07:06.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-11-18T21:07:06.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 557062230 } })
67192024-11-18T21:07:06.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
67202024-11-18T21:07:06.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 557705624 } })
67212024-11-18T21:07:06.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
67222024-11-18T21:07:06.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:57:06.239785640 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67232024-11-18T21:07:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.963597ms iteration = 7 status = {"expiration":"2024-11-18T20:57:06.239785640Z","pruned":[]}
67242024-11-18T21:07:06.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67252024-11-18T21:07:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67262024-11-18T21:07:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67272024-11-18T21:07:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.337908ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67282024-11-18T21:07:06.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67292024-11-18T21:07:06.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67302024-11-18T21:07:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67312024-11-18T21:07:06.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67322024-11-18T21:07:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67332024-11-18T21:07:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67342024-11-18T21:07:06.250ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67352024-11-18T21:07:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67362024-11-18T21:07:06.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67372024-11-18T21:07:06.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67382024-11-18T21:07:06.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67392024-11-18T21:07:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67402024-11-18T21:07:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.783689ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
67412024-11-18T21:07:06.260ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-11-18T21:07:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67432024-11-18T21:07:06.262ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67442024-11-18T21:07:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67452024-11-18T21:07:06.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67462024-11-18T21:07:06.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67472024-11-18T21:07:06.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67482024-11-18T21:07:06.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67492024-11-18T21:07:06.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67502024-11-18T21:07:06.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67512024-11-18T21:07:06.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67522024-11-18T21:07:06.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67532024-11-18T21:07:06.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542024-11-18T21:07:06.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67552024-11-18T21:07:06.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67562024-11-18T21:07:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67572024-11-18T21:07:06.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67582024-11-18T21:07:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67592024-11-18T21:07:06.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.285975ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
67602024-11-18T21:07:06.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67612024-11-18T21:07:06.293ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 607189983 } })
67622024-11-18T21:07:06.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-11-18T21:07:06.293ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
67642024-11-18T21:07:06.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67652024-11-18T21:07:06.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67662024-11-18T21:07:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67672024-11-18T21:07:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67682024-11-18T21:07:06.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67692024-11-18T21:07:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67702024-11-18T21:07:06.296ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-11-18T21:07:06.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67722024-11-18T21:07:06.298ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67732024-11-18T21:07:06.298ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67742024-11-18T21:07:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67752024-11-18T21:07:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67762024-11-18T21:07:06.299ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
67772024-11-18T21:07:06.299ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
67782024-11-18T21:07:06.299ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.10409ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
67792024-11-18T21:07:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67802024-11-18T21:07:06.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67812024-11-18T21:07:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67822024-11-18T21:07:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67832024-11-18T21:07:06.301ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67842024-11-18T21:07:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67852024-11-18T21:07:06.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-11-18T21:07:06.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.429958ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
67872024-11-18T21:07:06.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67882024-11-18T21:07:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67892024-11-18T21:07:06.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67902024-11-18T21:07:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67912024-11-18T21:07:06.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-11-18T21:07:06.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67932024-11-18T21:07:06.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67942024-11-18T21:07:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67952024-11-18T21:07:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67962024-11-18T21:07:06.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67972024-11-18T21:07:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67982024-11-18T21:07:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67992024-11-18T21:07:06.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68002024-11-18T21:07:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68012024-11-18T21:07:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68022024-11-18T21:07:06.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68032024-11-18T21:07:06.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68042024-11-18T21:07:06.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052024-11-18T21:07:06.315ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68062024-11-18T21:07:06.315ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68072024-11-18T21:07:06.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68082024-11-18T21:07:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68092024-11-18T21:07:06.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.420633ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68102024-11-18T21:07:06.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68112024-11-18T21:07:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68122024-11-18T21:07:06.317ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 77.000215ms iteration = 4 status = {"nsuccess":5}
68132024-11-18T21:07:06.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68142024-11-18T21:07:06.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.443993ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68152024-11-18T21:07:06.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68162024-11-18T21:07:06.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68172024-11-18T21:07:06.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68182024-11-18T21:07:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68192024-11-18T21:07:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68202024-11-18T21:07:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68212024-11-18T21:07:06.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-11-18T21:07:06.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68232024-11-18T21:07:06.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68242024-11-18T21:07:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
68252024-11-18T21:07:06.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68262024-11-18T21:07:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68272024-11-18T21:07:06.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68282024-11-18T21:07:06.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68292024-11-18T21:07:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68302024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68312024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68322024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68332024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68342024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68352024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68362024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68372024-11-18T21:07:06.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68382024-11-18T21:07:06.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392024-11-18T21:07:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68402024-11-18T21:07:06.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68412024-11-18T21:07:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68422024-11-18T21:07:06.346ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.733669ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68432024-11-18T21:07:06.346ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68442024-11-18T21:07:06.346ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68452024-11-18T21:07:06.346ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.247392ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68462024-11-18T21:07:06.349ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
68472024-11-18T21:07:06.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.978183ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
68482024-11-18T21:07:06.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68492024-11-18T21:07:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68502024-11-18T21:07:06.357ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68512024-11-18T21:07:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68522024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68532024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68542024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68552024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68562024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68572024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68582024-11-18T21:07:06.358ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68592024-11-18T21:07:06.358ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.363113ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68602024-11-18T21:07:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68612024-11-18T21:07:06.360ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68622024-11-18T21:07:06.360ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68632024-11-18T21:07:06.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68642024-11-18T21:07:06.360ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68652024-11-18T21:07:06.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68662024-11-18T21:07:06.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68672024-11-18T21:07:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68682024-11-18T21:07:06.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68692024-11-18T21:07:06.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68702024-11-18T21:07:06.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68712024-11-18T21:07:06.367ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68722024-11-18T21:07:06.367ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68732024-11-18T21:07:06.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68742024-11-18T21:07:06.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68752024-11-18T21:07:06.368ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68762024-11-18T21:07:06.368ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
68772024-11-18T21:07:06.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68782024-11-18T21:07:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68792024-11-18T21:07:06.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68802024-11-18T21:07:06.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68812024-11-18T21:07:06.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68822024-11-18T21:07:06.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68832024-11-18T21:07:06.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68842024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68852024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68862024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68872024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
68882024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68892024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
68902024-11-18T21:07:06.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 135.180568ms iteration = 7 status = {"generation":1}
68912024-11-18T21:07:06.376ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
68922024-11-18T21:07:06.376ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68932024-11-18T21:07:06.376ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68942024-11-18T21:07:06.376ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
68952024-11-18T21:07:06.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 137.189893ms iteration = 7 status = {"generation":2}
68962024-11-18T21:07:06.382ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
68972024-11-18T21:07:06.382ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 142.658784ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68982024-11-18T21:07:06.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68992024-11-18T21:07:06.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69002024-11-18T21:07:06.391ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69012024-11-18T21:07:06.391ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69022024-11-18T21:07:06.391ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.349478ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69032024-11-18T21:07:06.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69042024-11-18T21:07:06.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.912108ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69052024-11-18T21:07:06.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
69062024-11-18T21:07:06.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69072024-11-18T21:07:06.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69082024-11-18T21:07:06.411ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.837374ms iteration = 13 status = 0
69092024-11-18T21:07:06.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
69102024-11-18T21:07:06.411ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69112024-11-18T21:07:06.412ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2167836e-0b5e-4306-902f-252c8c3c40a6", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69122024-11-18T21:07:06.412ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69132024-11-18T21:07:06.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69142024-11-18T21:07:06.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69152024-11-18T21:07:06.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69162024-11-18T21:07:06.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172024-11-18T21:07:06.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69182024-11-18T21:07:06.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69192024-11-18T21:07:06.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69202024-11-18T21:07:06.447ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.216325ms iteration = 15 status = {"physical_disks_added":0}
69212024-11-18T21:07:06.448ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-11-18T21:07:06.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69232024-11-18T21:07:06.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69242024-11-18T21:07:06.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69252024-11-18T21:07:06.472ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69262024-11-18T21:07:06.472ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 232.292873ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69272024-11-18T21:07:06.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69282024-11-18T21:07:06.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
69292024-11-18T21:07:06.527ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69302024-11-18T21:07:06.527ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ae32e3b-2a14-4f84-9a1d-f79efa6100f1", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69312024-11-18T21:07:06.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69322024-11-18T21:07:06.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
69332024-11-18T21:07:06.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69342024-11-18T21:07:06.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
69352024-11-18T21:07:06.547ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69362024-11-18T21:07:06.548ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f1631a9-03ee-49c4-a94f-c439f749fe2b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69372024-11-18T21:07:06.548ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69382024-11-18T21:07:06.549ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69392024-11-18T21:07:06.628ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69402024-11-18T21:07:06.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69412024-11-18T21:07:06.645ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.021288ms iteration = 13 status = {}
69422024-11-18T21:07:06.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69432024-11-18T21:07:06.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5b2983c5-caa0-4561-b7a0-c4ea649bcd7b", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69442024-11-18T21:07:06.682ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69452024-11-18T21:07:06.683ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "436f66b5-57ab-4cd7-a583-f4acfc35df61", "date": "Mon, 18 Nov 2024 21:07:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69462024-11-18T21:07:06.683ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69472024-11-18T21:07:06.685ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f8e63efa-ad6a-4855-8353-629b6deb2c22", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69482024-11-18T21:07:06.685ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69492024-11-18T21:07:06.687ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69502024-11-18T21:07:06.687ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.81465ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69512024-11-18T21:07:06.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "581747b6-0687-463d-9c93-fdc2193a0916", "content-length": "372", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69522024-11-18T21:07:06.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69532024-11-18T21:07:06.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69542024-11-18T21:07:06.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69552024-11-18T21:07:06.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b3c9198b-6c96-4b5f-9378-5ee0c88a1a16", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69562024-11-18T21:07:06.697ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69572024-11-18T21:07:06.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5216f4b4-9fa4-4d48-a0a5-66f251cb8c51", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69582024-11-18T21:07:06.698ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69592024-11-18T21:07:06.700ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69602024-11-18T21:07:06.700ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 460.586776ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69612024-11-18T21:07:06.700ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69622024-11-18T21:07:06.700ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8574a887-1169-4643-b507-6bf9ce0a7d95", "content-length": "1", "date": "Mon, 18 Nov 2024 21:07:05 GMT"} })
69632024-11-18T21:07:06.702ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69642024-11-18T21:07:06.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69652024-11-18T21:07:06.703ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.094241ms iteration = 13 status = null
69662024-11-18T21:07:06.710ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69672024-11-18T21:07:06.710ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69682024-11-18T21:07:06.710ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b5702c5d-5523-4f31-b290-6b1b1338b778", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69692024-11-18T21:07:06.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69702024-11-18T21:07:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69712024-11-18T21:07:06.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69722024-11-18T21:07:06.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69732024-11-18T21:07:06.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69742024-11-18T21:07:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69752024-11-18T21:07:06.727ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69762024-11-18T21:07:06.727ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f998a39-0203-40d7-9339-da632090ccda", "content-length": "691", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69772024-11-18T21:07:06.727ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
69782024-11-18T21:07:06.727ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
69792024-11-18T21:07:06.727ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
69802024-11-18T21:07:06.728ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 488.658895ms iteration = 13 status = {}
69812024-11-18T21:07:06.729ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69822024-11-18T21:07:06.729ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69832024-11-18T21:07:06.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c65df37-0f13-43ac-93eb-fda0b740ade3", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
69842024-11-18T21:07:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 491.624806ms iteration = 13 status = {}
69852024-11-18T21:07:06.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69862024-11-18T21:07:06.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69872024-11-18T21:07:06.781ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
69882024-11-18T21:07:06.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69892024-11-18T21:07:06.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69902024-11-18T21:07:06.789ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69912024-11-18T21:07:06.790ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8717497-55de-43e7-ac3d-a0d0888f58b4", "content-length": "134", "date": "Mon, 18 Nov 2024 21:07:05 GMT"} })
69922024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69932024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
69942024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69952024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69962024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69972024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69982024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69992024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70002024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70012024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70022024-11-18T21:07:06.790ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
70032024-11-18T21:07:06.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70042024-11-18T21:07:06.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70052024-11-18T21:07:06.793ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70062024-11-18T21:07:06.793ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "de7f33c7-8b1c-403b-afa4-bc0525a306c2", "content-length": "2", "date": "Mon, 18 Nov 2024 21:07:05 GMT"} })
70072024-11-18T21:07:06.793ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70082024-11-18T21:07:06.793ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d1ff865-cc69-44c6-8555-39c6e174ba1f", "content-length": "51", "date": "Mon, 18 Nov 2024 21:07:05 GMT"} })
70092024-11-18T21:07:06.793ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
70102024-11-18T21:07:06.793ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70112024-11-18T21:07:06.893ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c5d7a8dc-3918-4f6e-adcc-0c1c8c58db14", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
70122024-11-18T21:07:06.893ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
70132024-11-18T21:07:06.893ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70142024-11-18T21:07:06.893ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0eb2fbb-1f57-4491-b783-2d2c7bb42692", "content-length": "682", "date": "Mon, 18 Nov 2024 21:07:06 GMT"} })
70152024-11-18T21:07:06.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70162024-11-18T21:07:06.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70172024-11-18T21:07:06.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70182024-11-18T21:07:06.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70192024-11-18T21:07:06.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70202024-11-18T21:07:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70212024-11-18T21:07:06.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70222024-11-18T21:07:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70232024-11-18T21:07:06.911ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.769292ms iteration = 13 status = {}
70242024-11-18T21:07:07.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1050e130-e634-44dd-9d29-305e6909b422 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70252024-11-18T21:07:07.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1050e130-e634-44dd-9d29-305e6909b422 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70262024-11-18T21:07:07.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1050e130-e634-44dd-9d29-305e6909b422 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70272024-11-18T21:07:08.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7272f72-2102-4402-9a4b-c66060382401 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70282024-11-18T21:07:08.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7272f72-2102-4402-9a4b-c66060382401 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70292024-11-18T21:07:08.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d7272f72-2102-4402-9a4b-c66060382401 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70302024-11-18T21:07:09.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 474a5930-8b9d-4e66-86d7-4c2b43e9d874 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70312024-11-18T21:07:09.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 474a5930-8b9d-4e66-86d7-4c2b43e9d874 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70322024-11-18T21:07:09.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 474a5930-8b9d-4e66-86d7-4c2b43e9d874 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70332024-11-18T21:07:10.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 230df789-fc74-440c-ab33-0554b2b2bf94 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70342024-11-18T21:07:10.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 230df789-fc74-440c-ab33-0554b2b2bf94 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70352024-11-18T21:07:10.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 230df789-fc74-440c-ab33-0554b2b2bf94 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70362024-11-18T21:07:11.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed70b30-94e0-499f-8114-e5214358ca8f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70372024-11-18T21:07:11.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed70b30-94e0-499f-8114-e5214358ca8f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70382024-11-18T21:07:11.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed70b30-94e0-499f-8114-e5214358ca8f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70392024-11-18T21:07:12.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03b1903-1ea7-489d-b653-187f206a858a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70402024-11-18T21:07:12.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03b1903-1ea7-489d-b653-187f206a858a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70412024-11-18T21:07:12.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e03b1903-1ea7-489d-b653-187f206a858a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70422024-11-18T21:07:13.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfe6ed69-95a3-4f27-a5bd-97de7e3bfd13 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70432024-11-18T21:07:13.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfe6ed69-95a3-4f27-a5bd-97de7e3bfd13 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70442024-11-18T21:07:13.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfe6ed69-95a3-4f27-a5bd-97de7e3bfd13 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70452024-11-18T21:07:14.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7042acdf-a3cb-4712-91dc-14d2689ca13d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70462024-11-18T21:07:14.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7042acdf-a3cb-4712-91dc-14d2689ca13d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70472024-11-18T21:07:14.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7042acdf-a3cb-4712-91dc-14d2689ca13d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70482024-11-18T21:07:15.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7957ef95-7a03-43a8-a8c5-e861a370baeb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70492024-11-18T21:07:15.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7957ef95-7a03-43a8-a8c5-e861a370baeb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70502024-11-18T21:07:15.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7957ef95-7a03-43a8-a8c5-e861a370baeb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70512024-11-18T21:07:16.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
70522024-11-18T21:07:16.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
70532024-11-18T21:07:16.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70542024-11-18T21:07:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70552024-11-18T21:07:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70562024-11-18T21:07:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70572024-11-18T21:07:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582024-11-18T21:07:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70592024-11-18T21:07:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70602024-11-18T21:07:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70612024-11-18T21:07:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622024-11-18T21:07:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70632024-11-18T21:07:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70642024-11-18T21:07:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
70652024-11-18T21:07:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70662024-11-18T21:07:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70672024-11-18T21:07:16.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
70682024-11-18T21:07:16.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.07864ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
70692024-11-18T21:07:16.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70702024-11-18T21:07:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70712024-11-18T21:07:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.363706ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70722024-11-18T21:07:16.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bf9e18f-be5a-4ac4-96fe-6af82a457d64 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70732024-11-18T21:07:16.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bf9e18f-be5a-4ac4-96fe-6af82a457d64 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70742024-11-18T21:07:16.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bf9e18f-be5a-4ac4-96fe-6af82a457d64 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70752024-11-18T21:07:17.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 083317f7-c9ac-4ae5-8617-fe00bd874b96 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70762024-11-18T21:07:17.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 083317f7-c9ac-4ae5-8617-fe00bd874b96 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70772024-11-18T21:07:17.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 083317f7-c9ac-4ae5-8617-fe00bd874b96 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70782024-11-18T21:07:18.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 73d425a2-0249-444b-8f35-db5e0f708407 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70792024-11-18T21:07:18.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 73d425a2-0249-444b-8f35-db5e0f708407 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70802024-11-18T21:07:18.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 73d425a2-0249-444b-8f35-db5e0f708407 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70812024-11-18T21:07:19.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4630cbe9-d194-4662-aa81-ef56d53e8f2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70822024-11-18T21:07:19.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4630cbe9-d194-4662-aa81-ef56d53e8f2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70832024-11-18T21:07:19.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4630cbe9-d194-4662-aa81-ef56d53e8f2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70842024-11-18T21:07:20.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05fb1b9c-39ab-4fd2-ba78-5a950cb4433b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70852024-11-18T21:07:20.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05fb1b9c-39ab-4fd2-ba78-5a950cb4433b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70862024-11-18T21:07:20.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 05fb1b9c-39ab-4fd2-ba78-5a950cb4433b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70872024-11-18T21:07:20.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 282ea8ce-def0-4b17-84b5-ca876477f4c0 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
70882024-11-18T21:07:21.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3c033f5-c1ae-459e-a2b1-5368f4696432 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70892024-11-18T21:07:21.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3c033f5-c1ae-459e-a2b1-5368f4696432 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70902024-11-18T21:07:21.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3c033f5-c1ae-459e-a2b1-5368f4696432 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70912024-11-18T21:07:22.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 170bb676-a259-474b-b84d-ea387fbe262a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70922024-11-18T21:07:22.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 170bb676-a259-474b-b84d-ea387fbe262a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70932024-11-18T21:07:22.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 170bb676-a259-474b-b84d-ea387fbe262a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70942024-11-18T21:07:23.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1cfc2afb-ee68-405e-bb88-56a216a9be47 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70952024-11-18T21:07:23.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1cfc2afb-ee68-405e-bb88-56a216a9be47 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70962024-11-18T21:07:23.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1cfc2afb-ee68-405e-bb88-56a216a9be47 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70972024-11-18T21:07:24.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27fcf92e-2dd9-4631-b8d6-a85d45879c66 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70982024-11-18T21:07:24.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27fcf92e-2dd9-4631-b8d6-a85d45879c66 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
70992024-11-18T21:07:24.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27fcf92e-2dd9-4631-b8d6-a85d45879c66 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71002024-11-18T21:07:25.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c411b933-3d2d-47f7-a1df-b968bb96ba83 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71012024-11-18T21:07:25.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c411b933-3d2d-47f7-a1df-b968bb96ba83 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71022024-11-18T21:07:25.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c411b933-3d2d-47f7-a1df-b968bb96ba83 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71032024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
71042024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
71052024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71062024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71072024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71082024-11-18T21:07:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71092024-11-18T21:07:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102024-11-18T21:07:26.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71112024-11-18T21:07:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71122024-11-18T21:07:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.718128ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71132024-11-18T21:07:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71142024-11-18T21:07:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71152024-11-18T21:07:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71162024-11-18T21:07:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71172024-11-18T21:07:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71182024-11-18T21:07:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71192024-11-18T21:07:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
71202024-11-18T21:07:26.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71212024-11-18T21:07:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71222024-11-18T21:07:26.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
71232024-11-18T21:07:26.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.463827ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
71242024-11-18T21:07:26.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e6188fd-0197-4176-9848-9a9e1ba3943f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71252024-11-18T21:07:26.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e6188fd-0197-4176-9848-9a9e1ba3943f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71262024-11-18T21:07:26.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e6188fd-0197-4176-9848-9a9e1ba3943f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71272024-11-18T21:07:27.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e17b787-9523-47f0-b45b-7f31ef7bf3d6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71282024-11-18T21:07:27.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e17b787-9523-47f0-b45b-7f31ef7bf3d6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71292024-11-18T21:07:27.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e17b787-9523-47f0-b45b-7f31ef7bf3d6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71302024-11-18T21:07:28.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38639f86-1f9b-4c88-9340-6671c4c55557 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71312024-11-18T21:07:28.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38639f86-1f9b-4c88-9340-6671c4c55557 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71322024-11-18T21:07:28.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38639f86-1f9b-4c88-9340-6671c4c55557 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71332024-11-18T21:07:29.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c50a2ee-409a-4bab-8695-8dbcfce13504 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71342024-11-18T21:07:29.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c50a2ee-409a-4bab-8695-8dbcfce13504 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71352024-11-18T21:07:29.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c50a2ee-409a-4bab-8695-8dbcfce13504 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71362024-11-18T21:07:30.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37f3fe60-7e13-485f-8842-e8510a747ebc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71372024-11-18T21:07:30.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37f3fe60-7e13-485f-8842-e8510a747ebc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71382024-11-18T21:07:30.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37f3fe60-7e13-485f-8842-e8510a747ebc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71392024-11-18T21:07:31.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 51e5499a-2f1c-44e1-b1d6-bb8f09136f29 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71402024-11-18T21:07:31.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 51e5499a-2f1c-44e1-b1d6-bb8f09136f29 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71412024-11-18T21:07:31.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 51e5499a-2f1c-44e1-b1d6-bb8f09136f29 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71422024-11-18T21:07:32.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0318a7d2-eb61-4ff5-9b2d-9e25e90c8ba1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71432024-11-18T21:07:32.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0318a7d2-eb61-4ff5-9b2d-9e25e90c8ba1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71442024-11-18T21:07:32.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0318a7d2-eb61-4ff5-9b2d-9e25e90c8ba1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71452024-11-18T21:07:33.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa518af9-7f0b-4a76-9e00-77c257b00cec roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71462024-11-18T21:07:33.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa518af9-7f0b-4a76-9e00-77c257b00cec resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71472024-11-18T21:07:33.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa518af9-7f0b-4a76-9e00-77c257b00cec response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71482024-11-18T21:07:34.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 289339c3-feb3-4aa5-83fa-87d54597c542 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71492024-11-18T21:07:34.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 289339c3-feb3-4aa5-83fa-87d54597c542 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71502024-11-18T21:07:34.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 289339c3-feb3-4aa5-83fa-87d54597c542 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71512024-11-18T21:07:35.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2f491ec-dd9e-4d24-87ac-8563b118c830 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71522024-11-18T21:07:35.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2f491ec-dd9e-4d24-87ac-8563b118c830 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71532024-11-18T21:07:35.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2f491ec-dd9e-4d24-87ac-8563b118c830 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
71542024-11-18T21:07:35.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = e10c1770-01ee-4e62-ac52-0b68f8492e0b response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
71552024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
71562024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71572024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
71582024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71592024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71602024-11-18T21:07:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71612024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
71622024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71632024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
71642024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
71652024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71662024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71672024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
71682024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
71692024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
71702024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71712024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71722024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
71732024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71742024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
71752024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
71762024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71772024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71782024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71792024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
71802024-11-18T21:07:36.240ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71812024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
71822024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71832024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71842024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
71852024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71862024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
71872024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
71882024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71892024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71902024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
71912024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71922024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71932024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71942024-11-18T21:07:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71952024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71962024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71972024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71982024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71992024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72002024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72022024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72032024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72042024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72052024-11-18T21:07:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72062024-11-18T21:07:36.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 556269354 } })
72072024-11-18T21:07:36.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 556315954 } })
72082024-11-18T21:07:36.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
72092024-11-18T21:07:36.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
72102024-11-18T21:07:36.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72112024-11-18T21:07:36.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122024-11-18T21:07:36.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.395182ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72132024-11-18T21:07:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72142024-11-18T21:07:36.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72152024-11-18T21:07:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72162024-11-18T21:07:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72172024-11-18T21:07:36.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72182024-11-18T21:07:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72192024-11-18T21:07:36.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.272729ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
72202024-11-18T21:07:36.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72212024-11-18T21:07:36.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72222024-11-18T21:07:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232024-11-18T21:07:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72242024-11-18T21:07:36.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72252024-11-18T21:07:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72262024-11-18T21:07:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72272024-11-18T21:07:36.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72282024-11-18T21:07:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72292024-11-18T21:07:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72302024-11-18T21:07:36.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72312024-11-18T21:07:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72322024-11-18T21:07:36.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72332024-11-18T21:07:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72342024-11-18T21:07:36.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1365, tv_nsec: 576117082 } })
72352024-11-18T21:07:36.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72362024-11-18T21:07:36.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72372024-11-18T21:07:36.262ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
72382024-11-18T21:07:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72392024-11-18T21:07:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72402024-11-18T21:07:36.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72412024-11-18T21:07:36.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72422024-11-18T21:07:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72432024-11-18T21:07:36.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72442024-11-18T21:07:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72452024-11-18T21:07:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
72462024-11-18T21:07:36.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72472024-11-18T21:07:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72482024-11-18T21:07:36.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.437369ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
72492024-11-18T21:07:36.283ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
72502024-11-18T21:07:36.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.729108ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
72512024-11-18T21:07:36.284ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72522024-11-18T21:07:36.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72532024-11-18T21:07:36.285ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72542024-11-18T21:07:36.285ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72552024-11-18T21:07:36.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72562024-11-18T21:07:36.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72572024-11-18T21:07:36.286ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72582024-11-18T21:07:36.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72592024-11-18T21:07:36.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72602024-11-18T21:07:36.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72612024-11-18T21:07:36.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72622024-11-18T21:07:36.292ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72632024-11-18T21:07:36.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72642024-11-18T21:07:36.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652024-11-18T21:07:36.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72662024-11-18T21:07:36.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.686473ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72672024-11-18T21:07:36.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72682024-11-18T21:07:36.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72692024-11-18T21:07:36.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72702024-11-18T21:07:36.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72712024-11-18T21:07:36.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-11-18T21:07:36.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72732024-11-18T21:07:36.297ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72742024-11-18T21:07:36.297ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.844835ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72752024-11-18T21:07:36.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72762024-11-18T21:07:36.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72772024-11-18T21:07:36.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72782024-11-18T21:07:36.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72792024-11-18T21:07:36.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72802024-11-18T21:07:36.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-11-18T21:07:36.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
72822024-11-18T21:07:36.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72832024-11-18T21:07:36.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72842024-11-18T21:07:36.305ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.782143ms iteration = 14 status = 0
72852024-11-18T21:07:36.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.719329ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72862024-11-18T21:07:36.321ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 80.599171ms iteration = 16 status = {"physical_disks_added":0}
72872024-11-18T21:07:36.321ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72882024-11-18T21:07:36.321ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72892024-11-18T21:07:36.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72902024-11-18T21:07:36.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72912024-11-18T21:07:36.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.423702ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72922024-11-18T21:07:36.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72932024-11-18T21:07:36.334ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72942024-11-18T21:07:36.334ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f077a076-d98e-4a5d-9c67-935092b10530", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
72952024-11-18T21:07:36.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72962024-11-18T21:07:36.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72972024-11-18T21:07:36.335ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72982024-11-18T21:07:36.336ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d25b05b2-0f0d-4efd-8ecc-bc1e450d8d4d", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
72992024-11-18T21:07:36.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73002024-11-18T21:07:36.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73012024-11-18T21:07:36.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73022024-11-18T21:07:36.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.061381ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73032024-11-18T21:07:36.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
73042024-11-18T21:07:36.354ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73052024-11-18T21:07:36.354ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4765367a-7225-4e83-ac77-88c3c8e98b34", "content-length": "26", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73062024-11-18T21:07:36.354ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73072024-11-18T21:07:36.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
73082024-11-18T21:07:36.359ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73092024-11-18T21:07:36.359ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73102024-11-18T21:07:36.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.627425ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73112024-11-18T21:07:36.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73122024-11-18T21:07:36.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73132024-11-18T21:07:36.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73142024-11-18T21:07:36.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73152024-11-18T21:07:36.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73162024-11-18T21:07:36.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73172024-11-18T21:07:36.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73182024-11-18T21:07:36.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73192024-11-18T21:07:36.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73202024-11-18T21:07:36.418ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73212024-11-18T21:07:36.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73222024-11-18T21:07:36.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73232024-11-18T21:07:36.572ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.944003ms iteration = 14 status = {}
73242024-11-18T21:07:36.575ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73252024-11-18T21:07:36.575ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a29ffee5-bbc5-44ee-a3bc-9dd3467fa758", "content-length": "1", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73262024-11-18T21:07:36.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73272024-11-18T21:07:36.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73282024-11-18T21:07:36.601ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73292024-11-18T21:07:36.601ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73302024-11-18T21:07:36.602ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73312024-11-18T21:07:36.603ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.692853ms iteration = 14 status = null
73322024-11-18T21:07:36.631ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a277feb5-011d-4111-94b0-849196a290aa", "content-length": "691", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73332024-11-18T21:07:36.631ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73342024-11-18T21:07:36.631ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73352024-11-18T21:07:36.631ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73362024-11-18T21:07:36.631ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f600de3-d572-4342-aca4-26a63df27cce", "content-length": "372", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73372024-11-18T21:07:36.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73382024-11-18T21:07:36.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73392024-11-18T21:07:36.633ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.8153ms iteration = 14 status = {}
73402024-11-18T21:07:36.648ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73412024-11-18T21:07:36.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73422024-11-18T21:07:36.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c01ca75d-263b-4d4d-bc7f-81487914eae5", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73432024-11-18T21:07:36.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73442024-11-18T21:07:36.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73452024-11-18T21:07:36.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73462024-11-18T21:07:36.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73472024-11-18T21:07:36.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73482024-11-18T21:07:36.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73492024-11-18T21:07:36.657ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73502024-11-18T21:07:36.657ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73512024-11-18T21:07:36.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "23880b7b-465b-4d5d-a93b-9e4ce54fc67e", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73522024-11-18T21:07:36.660ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.56431ms iteration = 14 status = {}
73532024-11-18T21:07:36.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73542024-11-18T21:07:36.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73552024-11-18T21:07:36.671ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
73562024-11-18T21:07:36.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73572024-11-18T21:07:36.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73582024-11-18T21:07:36.677ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73592024-11-18T21:07:36.678ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "55bf9382-03c5-4e6b-b989-908cbc90be7a", "content-length": "134", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73602024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73612024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
73622024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73632024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73642024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73652024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73662024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73672024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73682024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73692024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73702024-11-18T21:07:36.678ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
73712024-11-18T21:07:36.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73722024-11-18T21:07:36.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73732024-11-18T21:07:36.680ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73742024-11-18T21:07:36.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d18b0cdf-37b2-4035-ae53-998fb2cfadd0", "content-length": "2", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73752024-11-18T21:07:36.680ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73762024-11-18T21:07:36.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4b6d090-32b5-45c5-8262-6792638f5971", "content-length": "51", "date": "Mon, 18 Nov 2024 21:07:35 GMT"} })
73772024-11-18T21:07:36.680ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
73782024-11-18T21:07:36.680ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73792024-11-18T21:07:36.774ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e710110c-474d-477d-9968-100806bd237e", "date": "Mon, 18 Nov 2024 21:07:36 GMT"} })
73802024-11-18T21:07:36.774ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
73812024-11-18T21:07:36.774ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73822024-11-18T21:07:36.774ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a4a5c4-e296-4172-80b9-5565ad74db53", "content-length": "682", "date": "Mon, 18 Nov 2024 21:07:36 GMT"} })
73832024-11-18T21:07:36.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73842024-11-18T21:07:36.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73852024-11-18T21:07:36.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73862024-11-18T21:07:36.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73872024-11-18T21:07:36.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73882024-11-18T21:07:36.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73892024-11-18T21:07:36.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73902024-11-18T21:07:36.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73912024-11-18T21:07:36.790ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 549.359257ms iteration = 14 status = {}
73922024-11-18T21:07:36.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5b3c0029-409b-4c75-a8a3-459d22102d62 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73932024-11-18T21:07:36.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5b3c0029-409b-4c75-a8a3-459d22102d62 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73942024-11-18T21:07:36.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5b3c0029-409b-4c75-a8a3-459d22102d62 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73952024-11-18T21:07:37.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2960bdbb-c6a4-4cb9-8c61-3f70f540c707 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73962024-11-18T21:07:37.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2960bdbb-c6a4-4cb9-8c61-3f70f540c707 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73972024-11-18T21:07:37.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2960bdbb-c6a4-4cb9-8c61-3f70f540c707 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73982024-11-18T21:07:38.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6310bcbf-7dcf-4f64-8c15-b89ce48f2fb6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
73992024-11-18T21:07:38.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6310bcbf-7dcf-4f64-8c15-b89ce48f2fb6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74002024-11-18T21:07:38.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6310bcbf-7dcf-4f64-8c15-b89ce48f2fb6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74012024-11-18T21:07:39.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e242fc9-f1c5-4ada-b282-127fcdb3e66c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74022024-11-18T21:07:39.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e242fc9-f1c5-4ada-b282-127fcdb3e66c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74032024-11-18T21:07:39.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5e242fc9-f1c5-4ada-b282-127fcdb3e66c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74042024-11-18T21:07:40.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a77031d1-1bfd-4f6b-940e-29295b90a708 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74052024-11-18T21:07:40.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a77031d1-1bfd-4f6b-940e-29295b90a708 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74062024-11-18T21:07:40.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a77031d1-1bfd-4f6b-940e-29295b90a708 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74072024-11-18T21:07:41.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8157a016-7b1e-4329-8225-558fb94ec43c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74082024-11-18T21:07:41.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8157a016-7b1e-4329-8225-558fb94ec43c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74092024-11-18T21:07:41.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8157a016-7b1e-4329-8225-558fb94ec43c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74102024-11-18T21:07:43.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc550eb0-1a2f-44a7-9ff6-8de6bb3a2bd2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74112024-11-18T21:07:43.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc550eb0-1a2f-44a7-9ff6-8de6bb3a2bd2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74122024-11-18T21:07:43.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc550eb0-1a2f-44a7-9ff6-8de6bb3a2bd2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74132024-11-18T21:07:44.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa1dd7ee-cc71-4e9d-b40e-80a5f58f06fe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74142024-11-18T21:07:44.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa1dd7ee-cc71-4e9d-b40e-80a5f58f06fe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74152024-11-18T21:07:44.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aa1dd7ee-cc71-4e9d-b40e-80a5f58f06fe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74162024-11-18T21:07:45.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 084001e9-ab0e-4f8e-b6c9-53947d73c02d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74172024-11-18T21:07:45.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 084001e9-ab0e-4f8e-b6c9-53947d73c02d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74182024-11-18T21:07:45.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 084001e9-ab0e-4f8e-b6c9-53947d73c02d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74192024-11-18T21:07:46.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9248e2a0-0184-4438-a145-2e39732fe4e7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74202024-11-18T21:07:46.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9248e2a0-0184-4438-a145-2e39732fe4e7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74212024-11-18T21:07:46.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9248e2a0-0184-4438-a145-2e39732fe4e7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74222024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
74232024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
74242024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74252024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74262024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74272024-11-18T21:07:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74282024-11-18T21:07:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74292024-11-18T21:07:46.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74302024-11-18T21:07:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74312024-11-18T21:07:46.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.301812ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74322024-11-18T21:07:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74332024-11-18T21:07:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74342024-11-18T21:07:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74352024-11-18T21:07:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74362024-11-18T21:07:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74372024-11-18T21:07:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74382024-11-18T21:07:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
74392024-11-18T21:07:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74402024-11-18T21:07:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74412024-11-18T21:07:46.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
74422024-11-18T21:07:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.884083ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
74432024-11-18T21:07:47.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e166d103-cc0b-4103-b275-743f6865a685 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74442024-11-18T21:07:47.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e166d103-cc0b-4103-b275-743f6865a685 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74452024-11-18T21:07:47.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e166d103-cc0b-4103-b275-743f6865a685 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74462024-11-18T21:07:48.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5fe760ee-8fb5-4f17-89d6-59e385897f93 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74472024-11-18T21:07:48.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5fe760ee-8fb5-4f17-89d6-59e385897f93 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74482024-11-18T21:07:48.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5fe760ee-8fb5-4f17-89d6-59e385897f93 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74492024-11-18T21:07:49.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f022d8c3-a825-486a-b3da-0d679725f0b2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74502024-11-18T21:07:49.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f022d8c3-a825-486a-b3da-0d679725f0b2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74512024-11-18T21:07:49.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f022d8c3-a825-486a-b3da-0d679725f0b2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74522024-11-18T21:07:50.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eec3b90b-f8f0-4c58-bc5d-f66ab68107f9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74532024-11-18T21:07:50.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eec3b90b-f8f0-4c58-bc5d-f66ab68107f9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74542024-11-18T21:07:50.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eec3b90b-f8f0-4c58-bc5d-f66ab68107f9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74552024-11-18T21:07:50.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 837 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 97d599d3-6c32-428e-bc5a-82858c03947e response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
74562024-11-18T21:07:51.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b536f809-3d42-4bf5-a4a0-aece906be3aa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74572024-11-18T21:07:51.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b536f809-3d42-4bf5-a4a0-aece906be3aa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74582024-11-18T21:07:51.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b536f809-3d42-4bf5-a4a0-aece906be3aa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74592024-11-18T21:07:52.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f1b3644-3e11-4ac3-bf1f-e36375d1a12c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74602024-11-18T21:07:52.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f1b3644-3e11-4ac3-bf1f-e36375d1a12c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74612024-11-18T21:07:52.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f1b3644-3e11-4ac3-bf1f-e36375d1a12c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74622024-11-18T21:07:53.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89b7db95-612b-42f4-a9be-4764afed58b1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74632024-11-18T21:07:53.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89b7db95-612b-42f4-a9be-4764afed58b1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74642024-11-18T21:07:53.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89b7db95-612b-42f4-a9be-4764afed58b1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74652024-11-18T21:07:54.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e12f5e23-0185-4a5b-b825-e147504b60c6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74662024-11-18T21:07:54.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e12f5e23-0185-4a5b-b825-e147504b60c6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74672024-11-18T21:07:54.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e12f5e23-0185-4a5b-b825-e147504b60c6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74682024-11-18T21:07:55.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69f7bbee-29b3-4513-a181-0a0b2d82b864 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74692024-11-18T21:07:55.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69f7bbee-29b3-4513-a181-0a0b2d82b864 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74702024-11-18T21:07:55.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69f7bbee-29b3-4513-a181-0a0b2d82b864 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74712024-11-18T21:07:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
74722024-11-18T21:07:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74732024-11-18T21:07:56.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
74742024-11-18T21:07:56.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74752024-11-18T21:07:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74762024-11-18T21:07:56.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74772024-11-18T21:07:56.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74782024-11-18T21:07:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74792024-11-18T21:07:56.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74802024-11-18T21:07:56.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.12541ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74812024-11-18T21:07:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74822024-11-18T21:07:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74832024-11-18T21:07:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74842024-11-18T21:07:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74852024-11-18T21:07:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74862024-11-18T21:07:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74872024-11-18T21:07:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
74882024-11-18T21:07:56.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74892024-11-18T21:07:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74902024-11-18T21:07:56.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
74912024-11-18T21:07:56.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.475275ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
74922024-11-18T21:07:56.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3237a828-7aa0-441e-8568-3f0fc8cfae2c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74932024-11-18T21:07:56.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3237a828-7aa0-441e-8568-3f0fc8cfae2c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74942024-11-18T21:07:56.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3237a828-7aa0-441e-8568-3f0fc8cfae2c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74952024-11-18T21:07:57.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76b587d6-8bfe-4e74-8073-e9e868644b96 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74962024-11-18T21:07:57.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76b587d6-8bfe-4e74-8073-e9e868644b96 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74972024-11-18T21:07:57.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76b587d6-8bfe-4e74-8073-e9e868644b96 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74982024-11-18T21:07:58.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6a1498a-94f5-4eb5-9bca-f93d75ec0f6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
74992024-11-18T21:07:58.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6a1498a-94f5-4eb5-9bca-f93d75ec0f6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75002024-11-18T21:07:58.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6a1498a-94f5-4eb5-9bca-f93d75ec0f6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75012024-11-18T21:07:59.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8ea8991-1d68-4d71-a40b-d978536d1926 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75022024-11-18T21:07:59.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8ea8991-1d68-4d71-a40b-d978536d1926 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75032024-11-18T21:07:59.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b8ea8991-1d68-4d71-a40b-d978536d1926 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75042024-11-18T21:08:00.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 959c0125-6559-4ff1-be87-d47da575be79 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75052024-11-18T21:08:00.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 959c0125-6559-4ff1-be87-d47da575be79 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75062024-11-18T21:08:00.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 959c0125-6559-4ff1-be87-d47da575be79 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75072024-11-18T21:08:01.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21c79882-404e-473c-9e48-e360e3b7192f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75082024-11-18T21:08:01.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21c79882-404e-473c-9e48-e360e3b7192f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75092024-11-18T21:08:01.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 21c79882-404e-473c-9e48-e360e3b7192f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75102024-11-18T21:08:02.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1976506f-124f-46bd-b2ca-443a3aabff82 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75112024-11-18T21:08:02.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1976506f-124f-46bd-b2ca-443a3aabff82 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75122024-11-18T21:08:02.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1976506f-124f-46bd-b2ca-443a3aabff82 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75132024-11-18T21:08:03.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92190d24-3992-44c7-a39f-62aa5b13520b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75142024-11-18T21:08:03.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92190d24-3992-44c7-a39f-62aa5b13520b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75152024-11-18T21:08:03.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 92190d24-3992-44c7-a39f-62aa5b13520b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75162024-11-18T21:08:04.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 131ecb55-f5b0-480a-9d02-32944dbb091e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75172024-11-18T21:08:04.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 131ecb55-f5b0-480a-9d02-32944dbb091e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75182024-11-18T21:08:04.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 131ecb55-f5b0-480a-9d02-32944dbb091e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75192024-11-18T21:08:05.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2e51116-b8d0-4705-9e85-e2209761ba3b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75202024-11-18T21:08:05.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2e51116-b8d0-4705-9e85-e2209761ba3b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75212024-11-18T21:08:05.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2e51116-b8d0-4705-9e85-e2209761ba3b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
75222024-11-18T21:08:05.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 50f8f9e2-80d8-4b56-93d3-0c28f8602661 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
75232024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75242024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
75252024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75262024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75272024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
75282024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75292024-11-18T21:08:06.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75302024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75312024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75322024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
75332024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
75342024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75352024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75362024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75372024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75382024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
75392024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75402024-11-18T21:08:06.240ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:58:06.240007146 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75412024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75422024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75432024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75442024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75452024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75462024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75472024-11-18T21:08:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 553763175 } })
75482024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75492024-11-18T21:08:06.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 553792375 } })
75502024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
75512024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
75522024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
75532024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75542024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75552024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
75562024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75572024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75582024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
75592024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75602024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75612024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
75622024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
75632024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75642024-11-18T21:08:06.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75652024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
75662024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75672024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
75682024-11-18T21:08:06.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75692024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
75702024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75712024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75722024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
75732024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75742024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
75752024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
75762024-11-18T21:08:06.241ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
75772024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75782024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
75792024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.93\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
75802024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75812024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
75822024-11-18T21:08:06.241ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75832024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75842024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
75852024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
75862024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75872024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
75882024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
75892024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75902024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75912024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
75922024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75932024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75942024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75952024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
75962024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.30716ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
75972024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
75982024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.26689ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
75992024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76002024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76012024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76022024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76032024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76042024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76052024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76062024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76072024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76082024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76092024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76102024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76112024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76122024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76132024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76142024-11-18T21:08:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76152024-11-18T21:08:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76162024-11-18T21:08:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76172024-11-18T21:08:06.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 556144973 } })
76182024-11-18T21:08:06.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192024-11-18T21:08:06.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
76202024-11-18T21:08:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76212024-11-18T21:08:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76222024-11-18T21:08:06.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 557493243 } })
76232024-11-18T21:08:06.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
76242024-11-18T21:08:06.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:58:06.240007146 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76252024-11-18T21:08:06.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76262024-11-18T21:08:06.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76272024-11-18T21:08:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.929487ms iteration = 8 status = {"expiration":"2024-11-18T20:58:06.240007146Z","pruned":[]}
76282024-11-18T21:08:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76292024-11-18T21:08:06.247ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76302024-11-18T21:08:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76312024-11-18T21:08:06.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76322024-11-18T21:08:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76332024-11-18T21:08:06.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76342024-11-18T21:08:06.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-11-18T21:08:06.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76362024-11-18T21:08:06.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.723727ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76372024-11-18T21:08:06.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.422392ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
76382024-11-18T21:08:06.250ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76392024-11-18T21:08:06.250ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76402024-11-18T21:08:06.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76412024-11-18T21:08:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76422024-11-18T21:08:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76432024-11-18T21:08:06.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76442024-11-18T21:08:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76452024-11-18T21:08:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76462024-11-18T21:08:06.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76472024-11-18T21:08:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76482024-11-18T21:08:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76492024-11-18T21:08:06.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76502024-11-18T21:08:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76512024-11-18T21:08:06.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522024-11-18T21:08:06.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-11-18T21:08:06.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76542024-11-18T21:08:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76552024-11-18T21:08:06.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76562024-11-18T21:08:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76572024-11-18T21:08:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76582024-11-18T21:08:06.258ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76592024-11-18T21:08:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76602024-11-18T21:08:06.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76612024-11-18T21:08:06.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76622024-11-18T21:08:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76632024-11-18T21:08:06.259ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.436098ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
76642024-11-18T21:08:06.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76652024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76662024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76672024-11-18T21:08:06.261ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76682024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.995249ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76692024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76702024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76712024-11-18T21:08:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76722024-11-18T21:08:06.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76732024-11-18T21:08:06.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76742024-11-18T21:08:06.264ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76752024-11-18T21:08:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76762024-11-18T21:08:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76772024-11-18T21:08:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76782024-11-18T21:08:06.265ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76792024-11-18T21:08:06.265ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76802024-11-18T21:08:06.265ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76812024-11-18T21:08:06.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76822024-11-18T21:08:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76832024-11-18T21:08:06.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76842024-11-18T21:08:06.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76852024-11-18T21:08:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76862024-11-18T21:08:06.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76872024-11-18T21:08:06.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76882024-11-18T21:08:06.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76892024-11-18T21:08:06.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76902024-11-18T21:08:06.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76912024-11-18T21:08:06.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76922024-11-18T21:08:06.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76932024-11-18T21:08:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76942024-11-18T21:08:06.275ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1395, tv_nsec: 588691346 } })
76952024-11-18T21:08:06.275ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
76962024-11-18T21:08:06.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-11-18T21:08:06.277ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76982024-11-18T21:08:06.277ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.687564ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76992024-11-18T21:08:06.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77002024-11-18T21:08:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77012024-11-18T21:08:06.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77022024-11-18T21:08:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77032024-11-18T21:08:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77042024-11-18T21:08:06.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77052024-11-18T21:08:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77062024-11-18T21:08:06.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-11-18T21:08:06.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082024-11-18T21:08:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
77092024-11-18T21:08:06.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77102024-11-18T21:08:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77112024-11-18T21:08:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77122024-11-18T21:08:06.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77132024-11-18T21:08:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77142024-11-18T21:08:06.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77152024-11-18T21:08:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77162024-11-18T21:08:06.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77172024-11-18T21:08:06.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77182024-11-18T21:08:06.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.417958ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
77192024-11-18T21:08:06.313ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
77202024-11-18T21:08:06.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.553291ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
77212024-11-18T21:08:06.315ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77222024-11-18T21:08:06.315ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77232024-11-18T21:08:06.315ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77242024-11-18T21:08:06.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77252024-11-18T21:08:06.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77262024-11-18T21:08:06.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77272024-11-18T21:08:06.318ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77282024-11-18T21:08:06.318ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77292024-11-18T21:08:06.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77302024-11-18T21:08:06.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.964432ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77312024-11-18T21:08:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77322024-11-18T21:08:06.321ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77332024-11-18T21:08:06.321ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77342024-11-18T21:08:06.321ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.595461ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77352024-11-18T21:08:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77362024-11-18T21:08:06.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.870713ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
77372024-11-18T21:08:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77382024-11-18T21:08:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77392024-11-18T21:08:06.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77402024-11-18T21:08:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77412024-11-18T21:08:06.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77422024-11-18T21:08:06.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77432024-11-18T21:08:06.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77442024-11-18T21:08:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77452024-11-18T21:08:06.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462024-11-18T21:08:06.330ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77472024-11-18T21:08:06.330ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77482024-11-18T21:08:06.330ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.368257ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77492024-11-18T21:08:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
77502024-11-18T21:08:06.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77512024-11-18T21:08:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77522024-11-18T21:08:06.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77532024-11-18T21:08:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77542024-11-18T21:08:06.332ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.682444ms iteration = 15 status = 0
77552024-11-18T21:08:06.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77562024-11-18T21:08:06.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77572024-11-18T21:08:06.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77582024-11-18T21:08:06.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77592024-11-18T21:08:06.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77602024-11-18T21:08:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77612024-11-18T21:08:06.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77622024-11-18T21:08:06.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77632024-11-18T21:08:06.338ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77642024-11-18T21:08:06.338ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
77652024-11-18T21:08:06.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77662024-11-18T21:08:06.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77672024-11-18T21:08:06.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77682024-11-18T21:08:06.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77692024-11-18T21:08:06.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77702024-11-18T21:08:06.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77712024-11-18T21:08:06.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77722024-11-18T21:08:06.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77732024-11-18T21:08:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77742024-11-18T21:08:06.343ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77752024-11-18T21:08:06.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77762024-11-18T21:08:06.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77772024-11-18T21:08:06.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77782024-11-18T21:08:06.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77792024-11-18T21:08:06.344ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.884465ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77802024-11-18T21:08:06.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.87327ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77812024-11-18T21:08:06.353ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77822024-11-18T21:08:06.353ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77832024-11-18T21:08:06.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77842024-11-18T21:08:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77852024-11-18T21:08:06.385ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
77862024-11-18T21:08:06.385ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.023069ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77872024-11-18T21:08:06.394ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77882024-11-18T21:08:06.404ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.838802ms iteration = 17 status = {"physical_disks_added":0}
77892024-11-18T21:08:06.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77902024-11-18T21:08:06.418ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77912024-11-18T21:08:06.418ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73d18e64-d30e-456d-971b-f18ef7b3c173", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
77922024-11-18T21:08:06.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77932024-11-18T21:08:06.420ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77942024-11-18T21:08:06.437ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77952024-11-18T21:08:06.437ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 196.324714ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77962024-11-18T21:08:06.477ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
77972024-11-18T21:08:06.477ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77982024-11-18T21:08:06.477ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a3eb660-f34e-417e-bc95-1fc62d8ee5e0", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
77992024-11-18T21:08:06.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78002024-11-18T21:08:06.479ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
78012024-11-18T21:08:06.504ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78022024-11-18T21:08:06.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482e86ea-b128-4838-87bd-841fd121dde9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
78032024-11-18T21:08:06.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482e86ea-b128-4838-87bd-841fd121dde9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
78042024-11-18T21:08:06.562ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
78052024-11-18T21:08:06.562ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78062024-11-18T21:08:06.563ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae04a010-4518-48ef-be96-fa7859ac23bc", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
78072024-11-18T21:08:06.563ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78082024-11-18T21:08:06.564ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78092024-11-18T21:08:06.570ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78102024-11-18T21:08:06.571ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ed696f9e-e3dc-4919-9e7f-4b3523f2c956", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78112024-11-18T21:08:06.571ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78122024-11-18T21:08:06.572ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b4cd43f6-36ac-44de-a134-1433609e11a6", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78132024-11-18T21:08:06.572ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78142024-11-18T21:08:06.574ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78152024-11-18T21:08:06.574ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.637446ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78162024-11-18T21:08:06.584ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78172024-11-18T21:08:06.584ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78182024-11-18T21:08:06.584ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc99a2b0-bc7b-439c-8eb3-db520fea668b", "content-length": "372", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
78192024-11-18T21:08:06.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78202024-11-18T21:08:06.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78212024-11-18T21:08:06.621ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.572226ms iteration = 15 status = {}
78222024-11-18T21:08:06.621ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78232024-11-18T21:08:06.623ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
78242024-11-18T21:08:06.623ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78252024-11-18T21:08:06.623ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
78262024-11-18T21:08:06.623ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 383.256439ms iteration = 8 status = {"generation":2}
78272024-11-18T21:08:06.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78282024-11-18T21:08:06.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 482e86ea-b128-4838-87bd-841fd121dde9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
78292024-11-18T21:08:06.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78302024-11-18T21:08:06.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78312024-11-18T21:08:06.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78322024-11-18T21:08:06.628ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
78332024-11-18T21:08:06.628ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
78342024-11-18T21:08:06.628ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
78352024-11-18T21:08:06.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 388.960971ms iteration = 8 status = {"generation":1}
78362024-11-18T21:08:06.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78372024-11-18T21:08:06.663ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
78382024-11-18T21:08:06.663ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78392024-11-18T21:08:06.670ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78402024-11-18T21:08:06.670ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "80bf4e19-bad7-457b-adea-f496219d725b", "content-length": "1", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} })
78412024-11-18T21:08:06.672ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78422024-11-18T21:08:06.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78432024-11-18T21:08:06.674ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 434.933944ms iteration = 15 status = null
78442024-11-18T21:08:06.697ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6ccd1d7e-bee3-42a8-9a82-1f5de670bf08", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
78452024-11-18T21:08:06.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78462024-11-18T21:08:06.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78472024-11-18T21:08:06.697ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c0637c1-5a36-48dc-b4ee-f80cb473766e", "content-length": "691", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
78482024-11-18T21:08:06.697ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
78492024-11-18T21:08:06.697ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78502024-11-18T21:08:06.697ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
78512024-11-18T21:08:06.699ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 458.655141ms iteration = 15 status = {}
78522024-11-18T21:08:06.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78532024-11-18T21:08:06.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78542024-11-18T21:08:06.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78552024-11-18T21:08:06.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78562024-11-18T21:08:06.706ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78572024-11-18T21:08:06.706ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78582024-11-18T21:08:06.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5b440b4e-1e12-47e1-bf27-ca7a70906b2f", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
78592024-11-18T21:08:06.707ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 467.051553ms iteration = 15 status = {}
78602024-11-18T21:08:06.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78612024-11-18T21:08:06.717ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "16d3f6d9-5ac7-4425-84d9-09cc158ad96b", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78622024-11-18T21:08:06.717ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78632024-11-18T21:08:06.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8d6be0a4-5b7d-46b8-a263-f48b4993146b", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78642024-11-18T21:08:06.719ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78652024-11-18T21:08:06.721ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f7016af4-38af-4aa2-bbac-da1d146e74f9", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78662024-11-18T21:08:06.721ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78672024-11-18T21:08:06.722ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
78682024-11-18T21:08:06.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.038983ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78692024-11-18T21:08:06.732ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
78702024-11-18T21:08:06.732ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
78712024-11-18T21:08:06.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78722024-11-18T21:08:06.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78732024-11-18T21:08:06.761ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
78742024-11-18T21:08:06.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78752024-11-18T21:08:06.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78762024-11-18T21:08:06.767ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
78772024-11-18T21:08:06.767ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49286
78782024-11-18T21:08:06.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49286 req_id = 90e1e7df-9cbf-4fd9-8dd1-dff73c0d4b41 roles = RoleSet { roles: {} } uri = /metrics/producers
78792024-11-18T21:08:06.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49286 req_id = 90e1e7df-9cbf-4fd9-8dd1-dff73c0d4b41 resource = Database result = Ok(()) uri = /metrics/producers
78802024-11-18T21:08:06.770ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78812024-11-18T21:08:06.770ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cd98164-818b-4293-bb73-d05801cfab46", "content-length": "134", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} })
78822024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78832024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
78842024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78852024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78862024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78872024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78882024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78892024-11-18T21:08:06.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78902024-11-18T21:08:06.771ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78912024-11-18T21:08:06.771ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78922024-11-18T21:08:06.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
78932024-11-18T21:08:06.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78942024-11-18T21:08:06.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78952024-11-18T21:08:06.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78962024-11-18T21:08:06.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "445ad147-1f37-4d44-a946-f8ae2d499b76", "content-length": "2", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} })
78972024-11-18T21:08:06.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78982024-11-18T21:08:06.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "92e2fe0a-72e3-4fb5-9131-07f5e6784a25", "content-length": "51", "date": "Mon, 18 Nov 2024 21:08:05 GMT"} })
78992024-11-18T21:08:06.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
79002024-11-18T21:08:06.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79012024-11-18T21:08:06.803ZINFOnexus: assigned collector to new producer collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 file = nexus/src/app/oximeter.rs:76 producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
79022024-11-18T21:08:06.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36054 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49286 req_id = 90e1e7df-9cbf-4fd9-8dd1-dff73c0d4b41 response_code = 201 uri = /metrics/producers
79032024-11-18T21:08:06.803ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "90e1e7df-9cbf-4fd9-8dd1-dff73c0d4b41", "content-length": "41", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
79042024-11-18T21:08:06.805ZDEBGnexus (producer-registration-task): registered with nexus successfully
79052024-11-18T21:08:06.805ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
79062024-11-18T21:08:06.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "631d19cf-5562-470a-916e-bf99a439d31c", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
79072024-11-18T21:08:06.868ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
79082024-11-18T21:08:06.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79092024-11-18T21:08:06.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b6f1909-5f3b-42ea-8adf-1e324c2b112f", "content-length": "682", "date": "Mon, 18 Nov 2024 21:08:06 GMT"} })
79102024-11-18T21:08:06.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79112024-11-18T21:08:06.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79122024-11-18T21:08:06.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79132024-11-18T21:08:06.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79142024-11-18T21:08:06.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79152024-11-18T21:08:06.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79162024-11-18T21:08:06.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79172024-11-18T21:08:06.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79182024-11-18T21:08:06.884ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 643.460849ms iteration = 15 status = {}
79192024-11-18T21:08:07.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8c1cfc3-2ece-46ca-ac3f-3eec818ffdc1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79202024-11-18T21:08:07.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8c1cfc3-2ece-46ca-ac3f-3eec818ffdc1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79212024-11-18T21:08:07.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e8c1cfc3-2ece-46ca-ac3f-3eec818ffdc1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79222024-11-18T21:08:08.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76d807f5-8683-4e9b-8288-7f2d79263f96 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79232024-11-18T21:08:08.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76d807f5-8683-4e9b-8288-7f2d79263f96 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79242024-11-18T21:08:08.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76d807f5-8683-4e9b-8288-7f2d79263f96 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79252024-11-18T21:08:09.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4abcb7d-3a69-47d9-a1ca-0506dc657a6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79262024-11-18T21:08:09.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4abcb7d-3a69-47d9-a1ca-0506dc657a6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79272024-11-18T21:08:09.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4abcb7d-3a69-47d9-a1ca-0506dc657a6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79282024-11-18T21:08:10.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 176559ad-4ed4-4b35-8b1b-4eacf869b703 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79292024-11-18T21:08:10.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 176559ad-4ed4-4b35-8b1b-4eacf869b703 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79302024-11-18T21:08:10.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 176559ad-4ed4-4b35-8b1b-4eacf869b703 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79312024-11-18T21:08:11.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 690b3826-b394-4b5b-a717-1a348f4cca6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79322024-11-18T21:08:11.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 690b3826-b394-4b5b-a717-1a348f4cca6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79332024-11-18T21:08:11.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 690b3826-b394-4b5b-a717-1a348f4cca6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79342024-11-18T21:08:12.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 963b5d9b-7d9b-4e66-8145-4c2a243698a0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79352024-11-18T21:08:12.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 963b5d9b-7d9b-4e66-8145-4c2a243698a0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79362024-11-18T21:08:12.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 963b5d9b-7d9b-4e66-8145-4c2a243698a0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79372024-11-18T21:08:13.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c8419da-9331-41a6-84e4-f9833ace3d91 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79382024-11-18T21:08:13.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c8419da-9331-41a6-84e4-f9833ace3d91 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79392024-11-18T21:08:13.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c8419da-9331-41a6-84e4-f9833ace3d91 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79402024-11-18T21:08:14.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978dcc28-ad9a-4c8e-b1dd-7a23b6397bd9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79412024-11-18T21:08:14.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978dcc28-ad9a-4c8e-b1dd-7a23b6397bd9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79422024-11-18T21:08:14.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978dcc28-ad9a-4c8e-b1dd-7a23b6397bd9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79432024-11-18T21:08:15.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b10efb94-9b54-43dc-a242-73ce7650e82e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79442024-11-18T21:08:15.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b10efb94-9b54-43dc-a242-73ce7650e82e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79452024-11-18T21:08:15.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b10efb94-9b54-43dc-a242-73ce7650e82e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79462024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
79472024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
79482024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79492024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79502024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79512024-11-18T21:08:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79522024-11-18T21:08:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79532024-11-18T21:08:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79542024-11-18T21:08:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79552024-11-18T21:08:16.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.200771ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79562024-11-18T21:08:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79572024-11-18T21:08:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79582024-11-18T21:08:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79592024-11-18T21:08:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79602024-11-18T21:08:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79612024-11-18T21:08:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79622024-11-18T21:08:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
79632024-11-18T21:08:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79642024-11-18T21:08:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79652024-11-18T21:08:16.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
79662024-11-18T21:08:16.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.446345ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
79672024-11-18T21:08:16.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9b472a99-4baf-468e-88dd-0e29ebe0c161 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79682024-11-18T21:08:16.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9b472a99-4baf-468e-88dd-0e29ebe0c161 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79692024-11-18T21:08:16.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9b472a99-4baf-468e-88dd-0e29ebe0c161 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79702024-11-18T21:08:17.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 48b01021-1360-47a2-b803-9ffdd5aedcb9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79712024-11-18T21:08:17.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 48b01021-1360-47a2-b803-9ffdd5aedcb9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79722024-11-18T21:08:17.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 48b01021-1360-47a2-b803-9ffdd5aedcb9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79732024-11-18T21:08:18.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68ee2860-ebfa-43d7-9626-3273599d89a1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79742024-11-18T21:08:18.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68ee2860-ebfa-43d7-9626-3273599d89a1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79752024-11-18T21:08:18.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 68ee2860-ebfa-43d7-9626-3273599d89a1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79762024-11-18T21:08:19.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7411b84f-438f-40cb-8bcb-b7385fa52e39 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79772024-11-18T21:08:19.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7411b84f-438f-40cb-8bcb-b7385fa52e39 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79782024-11-18T21:08:19.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7411b84f-438f-40cb-8bcb-b7385fa52e39 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79792024-11-18T21:08:20.874ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 42a40567-29b8-49be-98aa-6684d5f207a9 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
79802024-11-18T21:08:21.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bc6df31-ca6a-4c96-86f0-ae231574c4dc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79812024-11-18T21:08:21.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bc6df31-ca6a-4c96-86f0-ae231574c4dc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79822024-11-18T21:08:21.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0bc6df31-ca6a-4c96-86f0-ae231574c4dc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79832024-11-18T21:08:22.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c0ee9d87-2910-4fbe-8ee8-fa90d1b177ea roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79842024-11-18T21:08:22.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c0ee9d87-2910-4fbe-8ee8-fa90d1b177ea resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79852024-11-18T21:08:22.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c0ee9d87-2910-4fbe-8ee8-fa90d1b177ea response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79862024-11-18T21:08:23.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed30404d-44ee-4a96-b43d-2540a445aec5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79872024-11-18T21:08:23.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed30404d-44ee-4a96-b43d-2540a445aec5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79882024-11-18T21:08:23.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed30404d-44ee-4a96-b43d-2540a445aec5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79892024-11-18T21:08:24.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 137eec87-6414-4539-a621-342f70cc816b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79902024-11-18T21:08:24.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 137eec87-6414-4539-a621-342f70cc816b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79912024-11-18T21:08:24.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 137eec87-6414-4539-a621-342f70cc816b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79922024-11-18T21:08:25.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bb5d5ee-b80b-4ec5-a18d-22f88ef466f7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79932024-11-18T21:08:25.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bb5d5ee-b80b-4ec5-a18d-22f88ef466f7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79942024-11-18T21:08:25.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bb5d5ee-b80b-4ec5-a18d-22f88ef466f7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
79952024-11-18T21:08:25.868ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45095
79962024-11-18T21:08:25.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = bb75fbd4-41a3-4788-93c5-9f3c43b16258 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
79972024-11-18T21:08:25.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = bb75fbd4-41a3-4788-93c5-9f3c43b16258 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
79982024-11-18T21:08:25.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = bb75fbd4-41a3-4788-93c5-9f3c43b16258 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
79992024-11-18T21:08:25.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e2dfb3b7-6821-4022-be61-19595c3a91aa roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
80002024-11-18T21:08:25.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e2dfb3b7-6821-4022-be61-19595c3a91aa resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
80012024-11-18T21:08:25.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e2dfb3b7-6821-4022-be61-19595c3a91aa response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
80022024-11-18T21:08:26.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bd6bef6f-a971-47bf-a586-294712dcc1a9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80032024-11-18T21:08:26.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bd6bef6f-a971-47bf-a586-294712dcc1a9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80042024-11-18T21:08:26.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bd6bef6f-a971-47bf-a586-294712dcc1a9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80052024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
80062024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80072024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
80082024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80092024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80102024-11-18T21:08:26.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80112024-11-18T21:08:26.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122024-11-18T21:08:26.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80132024-11-18T21:08:26.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80142024-11-18T21:08:26.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.353753ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80152024-11-18T21:08:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80162024-11-18T21:08:26.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80172024-11-18T21:08:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80182024-11-18T21:08:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80192024-11-18T21:08:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80202024-11-18T21:08:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80212024-11-18T21:08:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
80222024-11-18T21:08:26.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80232024-11-18T21:08:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80242024-11-18T21:08:26.260ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
80252024-11-18T21:08:26.260ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.266934ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
80262024-11-18T21:08:27.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64f18b13-8c3f-402d-ad56-e0bc5e2596a2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80272024-11-18T21:08:27.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64f18b13-8c3f-402d-ad56-e0bc5e2596a2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80282024-11-18T21:08:27.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 64f18b13-8c3f-402d-ad56-e0bc5e2596a2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80292024-11-18T21:08:28.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e253dc48-5ed3-4ae8-b349-4e8576beef27 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80302024-11-18T21:08:28.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e253dc48-5ed3-4ae8-b349-4e8576beef27 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80312024-11-18T21:08:28.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e253dc48-5ed3-4ae8-b349-4e8576beef27 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80322024-11-18T21:08:29.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2037bb91-8027-4eb2-bd16-5fbb971dc03f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80332024-11-18T21:08:29.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2037bb91-8027-4eb2-bd16-5fbb971dc03f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80342024-11-18T21:08:29.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2037bb91-8027-4eb2-bd16-5fbb971dc03f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80352024-11-18T21:08:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86131a29-693e-44d4-8ad5-a743f6bc26f1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80362024-11-18T21:08:30.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86131a29-693e-44d4-8ad5-a743f6bc26f1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80372024-11-18T21:08:30.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 86131a29-693e-44d4-8ad5-a743f6bc26f1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80382024-11-18T21:08:31.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47e65c92-2f0c-4620-9a2e-1f662b8914e8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80392024-11-18T21:08:31.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47e65c92-2f0c-4620-9a2e-1f662b8914e8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80402024-11-18T21:08:31.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 47e65c92-2f0c-4620-9a2e-1f662b8914e8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80412024-11-18T21:08:32.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d773b3df-7dce-4a51-a32f-d1a310d95275 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80422024-11-18T21:08:32.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d773b3df-7dce-4a51-a32f-d1a310d95275 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80432024-11-18T21:08:32.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d773b3df-7dce-4a51-a32f-d1a310d95275 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80442024-11-18T21:08:33.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ca879a9b-20c7-4ef1-a95f-9f60300ee4d8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80452024-11-18T21:08:33.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ca879a9b-20c7-4ef1-a95f-9f60300ee4d8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80462024-11-18T21:08:33.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ca879a9b-20c7-4ef1-a95f-9f60300ee4d8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80472024-11-18T21:08:34.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f319bb1-9ae9-4039-89fd-842e9f8a8122 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80482024-11-18T21:08:34.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f319bb1-9ae9-4039-89fd-842e9f8a8122 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80492024-11-18T21:08:34.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f319bb1-9ae9-4039-89fd-842e9f8a8122 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80502024-11-18T21:08:35.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fde203b1-e84e-400a-bad1-e002a9ae6d2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80512024-11-18T21:08:35.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fde203b1-e84e-400a-bad1-e002a9ae6d2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80522024-11-18T21:08:35.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fde203b1-e84e-400a-bad1-e002a9ae6d2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
80532024-11-18T21:08:35.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 695 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 33cec81b-af66-429a-8d67-9e9bc6ed072c response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
80542024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
80552024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80562024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
80572024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80582024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80592024-11-18T21:08:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80602024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
80612024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
80622024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80632024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80642024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
80652024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80662024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
80672024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80682024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
80692024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80702024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
80712024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
80722024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80732024-11-18T21:08:36.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80742024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80752024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80762024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
80772024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80782024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
80792024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80802024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
80812024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
80822024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80832024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80842024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
80852024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80862024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
80872024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80882024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
80892024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80902024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
80912024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80922024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80932024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80942024-11-18T21:08:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80952024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80962024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80972024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80982024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80992024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81002024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81012024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81022024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81032024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81042024-11-18T21:08:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81052024-11-18T21:08:36.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 556419645 } })
81062024-11-18T21:08:36.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 556680477 } })
81072024-11-18T21:08:36.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
81082024-11-18T21:08:36.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
81092024-11-18T21:08:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81102024-11-18T21:08:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81112024-11-18T21:08:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81122024-11-18T21:08:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81132024-11-18T21:08:36.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-11-18T21:08:36.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81152024-11-18T21:08:36.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.628375ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81162024-11-18T21:08:36.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81172024-11-18T21:08:36.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.721893ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
81182024-11-18T21:08:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81192024-11-18T21:08:36.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81202024-11-18T21:08:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81212024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81222024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81232024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81242024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81252024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81262024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81272024-11-18T21:08:36.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81282024-11-18T21:08:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81292024-11-18T21:08:36.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81302024-11-18T21:08:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81312024-11-18T21:08:36.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81322024-11-18T21:08:36.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81332024-11-18T21:08:36.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.222811ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81342024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81352024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81362024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81372024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81382024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81392024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81402024-11-18T21:08:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81412024-11-18T21:08:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81422024-11-18T21:08:36.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81432024-11-18T21:08:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81442024-11-18T21:08:36.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81452024-11-18T21:08:36.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81462024-11-18T21:08:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81472024-11-18T21:08:36.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81482024-11-18T21:08:36.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81492024-11-18T21:08:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81502024-11-18T21:08:36.261ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81512024-11-18T21:08:36.261ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.861858ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81522024-11-18T21:08:36.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81532024-11-18T21:08:36.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1425, tv_nsec: 575760689 } })
81542024-11-18T21:08:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81552024-11-18T21:08:36.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
81562024-11-18T21:08:36.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81572024-11-18T21:08:36.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 21.886173ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81582024-11-18T21:08:36.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81592024-11-18T21:08:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81602024-11-18T21:08:36.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81612024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81622024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81632024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
81642024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81652024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81662024-11-18T21:08:36.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81672024-11-18T21:08:36.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81682024-11-18T21:08:36.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81692024-11-18T21:08:36.276ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81702024-11-18T21:08:36.276ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81712024-11-18T21:08:36.276ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81722024-11-18T21:08:36.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81732024-11-18T21:08:36.277ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
81742024-11-18T21:08:36.277ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.843977ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
81752024-11-18T21:08:36.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81762024-11-18T21:08:36.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81772024-11-18T21:08:36.282ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81782024-11-18T21:08:36.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81792024-11-18T21:08:36.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.621038ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
81802024-11-18T21:08:36.287ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81812024-11-18T21:08:36.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81822024-11-18T21:08:36.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81832024-11-18T21:08:36.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81842024-11-18T21:08:36.335ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77a220f7-c0d1-4abb-835c-d003a6ce128d", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
81852024-11-18T21:08:36.335ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81862024-11-18T21:08:36.336ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81872024-11-18T21:08:36.336ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81882024-11-18T21:08:36.336ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e7d3a5f-a19c-4eb8-9bfc-1c8f23d31140", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
81892024-11-18T21:08:36.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81902024-11-18T21:08:36.337ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81912024-11-18T21:08:36.339ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81922024-11-18T21:08:36.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 266a4e31-e467-4cb2-9e5c-8aaa59496c91 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
81932024-11-18T21:08:36.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 266a4e31-e467-4cb2-9e5c-8aaa59496c91 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
81942024-11-18T21:08:36.368ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.987667ms iteration = 18 status = {"physical_disks_added":0}
81952024-11-18T21:08:36.369ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
81962024-11-18T21:08:36.369ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81972024-11-18T21:08:36.369ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f7ac402-fb2e-497a-afa0-9ba620da078c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
81982024-11-18T21:08:36.369ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81992024-11-18T21:08:36.371ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
82002024-11-18T21:08:36.445ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82012024-11-18T21:08:36.445ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82022024-11-18T21:08:36.445ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab1c6d71-0ba7-4bcc-8905-795936dd9751", "content-length": "372", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82032024-11-18T21:08:36.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82042024-11-18T21:08:36.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82052024-11-18T21:08:36.446ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.303468ms iteration = 16 status = {}
82062024-11-18T21:08:36.448ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82072024-11-18T21:08:36.448ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82082024-11-18T21:08:36.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82092024-11-18T21:08:36.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82102024-11-18T21:08:36.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82112024-11-18T21:08:36.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 266a4e31-e467-4cb2-9e5c-8aaa59496c91 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82122024-11-18T21:08:36.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82132024-11-18T21:08:36.474ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82142024-11-18T21:08:36.474ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a119c7e2-0f63-4175-93ea-2347536177d4", "content-length": "1", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82152024-11-18T21:08:36.477ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82162024-11-18T21:08:36.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82172024-11-18T21:08:36.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182024-11-18T21:08:36.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82192024-11-18T21:08:36.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82202024-11-18T21:08:36.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82212024-11-18T21:08:36.479ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.306005ms iteration = 16 status = null
82222024-11-18T21:08:36.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 239.281485ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82232024-11-18T21:08:36.482ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82242024-11-18T21:08:36.482ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82252024-11-18T21:08:36.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 240.981377ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82262024-11-18T21:08:36.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 243.536967ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82272024-11-18T21:08:36.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-11-18T21:08:36.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
82292024-11-18T21:08:36.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82302024-11-18T21:08:36.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82312024-11-18T21:08:36.490ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 248.747706ms iteration = 16 status = 0
82322024-11-18T21:08:36.497ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
82332024-11-18T21:08:36.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82342024-11-18T21:08:36.497ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "00f323b4-2518-4e79-bbfc-729678f0df4e", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82352024-11-18T21:08:36.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82362024-11-18T21:08:36.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82372024-11-18T21:08:36.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82382024-11-18T21:08:36.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82392024-11-18T21:08:36.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82402024-11-18T21:08:36.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82412024-11-18T21:08:36.506ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82422024-11-18T21:08:36.506ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82432024-11-18T21:08:36.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1a4812da-eab3-481f-89ed-832937d3e131", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82442024-11-18T21:08:36.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.744897ms iteration = 16 status = {}
82452024-11-18T21:08:36.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82462024-11-18T21:08:36.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82472024-11-18T21:08:36.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82482024-11-18T21:08:36.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82492024-11-18T21:08:36.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82502024-11-18T21:08:36.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82512024-11-18T21:08:36.538ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
82522024-11-18T21:08:36.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82532024-11-18T21:08:36.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82542024-11-18T21:08:36.547ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82552024-11-18T21:08:36.547ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "809ace6b-2933-4201-b6e5-60a6bf7ae648", "content-length": "134", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82562024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82572024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
82582024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82592024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82602024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82612024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82622024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82632024-11-18T21:08:36.547ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82642024-11-18T21:08:36.548ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82652024-11-18T21:08:36.548ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82662024-11-18T21:08:36.548ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
82672024-11-18T21:08:36.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82682024-11-18T21:08:36.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82692024-11-18T21:08:36.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82702024-11-18T21:08:36.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59ec4abe-e8c4-458e-9ac8-b05cc3243320", "content-length": "2", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82712024-11-18T21:08:36.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82722024-11-18T21:08:36.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0e9fdff-beb1-48de-a0a9-ea4b9aa2f930", "content-length": "51", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82732024-11-18T21:08:36.550ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
82742024-11-18T21:08:36.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82752024-11-18T21:08:36.604ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82762024-11-18T21:08:36.632ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "339faa60-69c0-4ebd-a8e6-76c1c163be71", "content-length": "691", "date": "Mon, 18 Nov 2024 21:08:36 GMT"} })
82772024-11-18T21:08:36.632ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82782024-11-18T21:08:36.632ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82792024-11-18T21:08:36.632ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82802024-11-18T21:08:36.633ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.159354ms iteration = 16 status = {}
82812024-11-18T21:08:36.718ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "632526fd-9c28-42fe-a038-c554192016a1", "date": "Mon, 18 Nov 2024 21:08:35 GMT"} })
82822024-11-18T21:08:36.718ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
82832024-11-18T21:08:36.718ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82842024-11-18T21:08:36.718ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "19f6dc56-7d85-49fb-ad7c-b52bafe81f30", "content-length": "682", "date": "Mon, 18 Nov 2024 21:08:36 GMT"} })
82852024-11-18T21:08:36.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82862024-11-18T21:08:36.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82872024-11-18T21:08:36.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82882024-11-18T21:08:36.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82892024-11-18T21:08:36.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82902024-11-18T21:08:36.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82912024-11-18T21:08:36.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82922024-11-18T21:08:36.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82932024-11-18T21:08:36.734ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.009666ms iteration = 16 status = {}
82942024-11-18T21:08:37.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f79409fe-83e8-4f52-b0cf-db98df39df74 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82952024-11-18T21:08:37.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f79409fe-83e8-4f52-b0cf-db98df39df74 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82962024-11-18T21:08:37.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f79409fe-83e8-4f52-b0cf-db98df39df74 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82972024-11-18T21:08:38.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30bc0b69-f312-4c6b-9437-0164ffd8b855 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82982024-11-18T21:08:38.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30bc0b69-f312-4c6b-9437-0164ffd8b855 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
82992024-11-18T21:08:38.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30bc0b69-f312-4c6b-9437-0164ffd8b855 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83002024-11-18T21:08:39.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a0c06ed-8fa5-4f7e-8a3e-1afaadfe3f08 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83012024-11-18T21:08:39.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a0c06ed-8fa5-4f7e-8a3e-1afaadfe3f08 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83022024-11-18T21:08:39.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5a0c06ed-8fa5-4f7e-8a3e-1afaadfe3f08 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83032024-11-18T21:08:40.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 79c02fe9-cefe-42d7-9779-5f8955b89a55 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83042024-11-18T21:08:40.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 79c02fe9-cefe-42d7-9779-5f8955b89a55 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83052024-11-18T21:08:40.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 79c02fe9-cefe-42d7-9779-5f8955b89a55 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83062024-11-18T21:08:41.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 121d0848-7f73-4f06-92dc-c96c22fd884f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83072024-11-18T21:08:41.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 121d0848-7f73-4f06-92dc-c96c22fd884f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83082024-11-18T21:08:41.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 121d0848-7f73-4f06-92dc-c96c22fd884f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83092024-11-18T21:08:42.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b80a9f1f-8f66-456b-bd3e-bfb050f7836a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83102024-11-18T21:08:42.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b80a9f1f-8f66-456b-bd3e-bfb050f7836a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83112024-11-18T21:08:42.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b80a9f1f-8f66-456b-bd3e-bfb050f7836a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83122024-11-18T21:08:43.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54f83910-b4b4-4e22-aee1-6d8b6e1f632c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83132024-11-18T21:08:43.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54f83910-b4b4-4e22-aee1-6d8b6e1f632c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83142024-11-18T21:08:43.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 54f83910-b4b4-4e22-aee1-6d8b6e1f632c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83152024-11-18T21:08:44.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04d841eb-df86-49d5-818c-d6e9d91d413c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83162024-11-18T21:08:44.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04d841eb-df86-49d5-818c-d6e9d91d413c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83172024-11-18T21:08:44.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04d841eb-df86-49d5-818c-d6e9d91d413c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83182024-11-18T21:08:45.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6678aee8-f545-4e8d-8a8d-11429ebbf567 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83192024-11-18T21:08:45.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6678aee8-f545-4e8d-8a8d-11429ebbf567 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83202024-11-18T21:08:45.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6678aee8-f545-4e8d-8a8d-11429ebbf567 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83212024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
83222024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83232024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
83242024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83252024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83262024-11-18T21:08:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83272024-11-18T21:08:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83282024-11-18T21:08:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83292024-11-18T21:08:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83302024-11-18T21:08:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83312024-11-18T21:08:46.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83322024-11-18T21:08:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83332024-11-18T21:08:46.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83342024-11-18T21:08:46.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83352024-11-18T21:08:46.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.559908ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83362024-11-18T21:08:46.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372024-11-18T21:08:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
83382024-11-18T21:08:46.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83392024-11-18T21:08:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83402024-11-18T21:08:46.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
83412024-11-18T21:08:46.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.050303ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
83422024-11-18T21:08:46.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = af3c4ed6-f869-4665-b902-5ffbd93bbf4c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83432024-11-18T21:08:46.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = af3c4ed6-f869-4665-b902-5ffbd93bbf4c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83442024-11-18T21:08:46.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = af3c4ed6-f869-4665-b902-5ffbd93bbf4c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83452024-11-18T21:08:47.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39330aa-bad0-4250-ac3a-d85df016210c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83462024-11-18T21:08:47.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39330aa-bad0-4250-ac3a-d85df016210c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83472024-11-18T21:08:47.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c39330aa-bad0-4250-ac3a-d85df016210c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83482024-11-18T21:08:48.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c3cf576-9e99-482a-86f1-057076fab9f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83492024-11-18T21:08:48.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c3cf576-9e99-482a-86f1-057076fab9f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83502024-11-18T21:08:48.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c3cf576-9e99-482a-86f1-057076fab9f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83512024-11-18T21:08:49.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19cdd267-5d45-4446-837f-be0b55975151 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83522024-11-18T21:08:49.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19cdd267-5d45-4446-837f-be0b55975151 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83532024-11-18T21:08:49.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19cdd267-5d45-4446-837f-be0b55975151 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83542024-11-18T21:08:50.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1fe107e-0bf6-488f-9833-43aa60158fcd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83552024-11-18T21:08:50.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1fe107e-0bf6-488f-9833-43aa60158fcd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83562024-11-18T21:08:50.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b1fe107e-0bf6-488f-9833-43aa60158fcd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83572024-11-18T21:08:50.876ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = fe87eb6d-956f-43db-9511-20e00eb1ff28 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
83582024-11-18T21:08:51.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87f8752a-038b-4058-a46f-226eb9664ebf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83592024-11-18T21:08:51.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87f8752a-038b-4058-a46f-226eb9664ebf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83602024-11-18T21:08:51.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 87f8752a-038b-4058-a46f-226eb9664ebf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83612024-11-18T21:08:52.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27b26ecb-6d40-441c-840b-3a5fcd532746 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83622024-11-18T21:08:52.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27b26ecb-6d40-441c-840b-3a5fcd532746 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83632024-11-18T21:08:52.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 27b26ecb-6d40-441c-840b-3a5fcd532746 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83642024-11-18T21:08:53.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f8d2d00-aeaa-4737-90af-527cc802e9fc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83652024-11-18T21:08:53.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f8d2d00-aeaa-4737-90af-527cc802e9fc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83662024-11-18T21:08:53.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f8d2d00-aeaa-4737-90af-527cc802e9fc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83672024-11-18T21:08:54.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0de280d-8652-450d-b0d9-cfaf691f6e1e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83682024-11-18T21:08:54.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0de280d-8652-450d-b0d9-cfaf691f6e1e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83692024-11-18T21:08:54.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0de280d-8652-450d-b0d9-cfaf691f6e1e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83702024-11-18T21:08:55.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e66b4c18-ce2b-417b-bd20-7c0fdafc3317 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
83712024-11-18T21:08:55.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e66b4c18-ce2b-417b-bd20-7c0fdafc3317 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
83722024-11-18T21:08:55.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = e66b4c18-ce2b-417b-bd20-7c0fdafc3317 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
83732024-11-18T21:08:55.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = 41fc5910-4061-48b3-9f4f-2edd993c6774 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
83742024-11-18T21:08:55.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = 41fc5910-4061-48b3-9f4f-2edd993c6774 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
83752024-11-18T21:08:55.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45095 req_id = 41fc5910-4061-48b3-9f4f-2edd993c6774 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
83762024-11-18T21:08:55.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3244e199-f7ee-451c-b025-97dac41b110b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83772024-11-18T21:08:55.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3244e199-f7ee-451c-b025-97dac41b110b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83782024-11-18T21:08:55.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3244e199-f7ee-451c-b025-97dac41b110b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
83792024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
83802024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
83812024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83822024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83832024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83842024-11-18T21:08:56.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83852024-11-18T21:08:56.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83862024-11-18T21:08:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83872024-11-18T21:08:56.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83882024-11-18T21:08:56.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.276995ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83892024-11-18T21:08:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83902024-11-18T21:08:56.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83912024-11-18T21:08:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83922024-11-18T21:08:56.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83932024-11-18T21:08:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83942024-11-18T21:08:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83952024-11-18T21:08:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
83962024-11-18T21:08:56.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83972024-11-18T21:08:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83982024-11-18T21:08:56.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
83992024-11-18T21:08:56.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.192998ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
84002024-11-18T21:08:56.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9088ecb2-f4e0-4121-8434-2411455df76d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84012024-11-18T21:08:56.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9088ecb2-f4e0-4121-8434-2411455df76d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84022024-11-18T21:08:56.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9088ecb2-f4e0-4121-8434-2411455df76d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84032024-11-18T21:08:57.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a5edf32-ed32-4e80-b756-f5ae5a9ecadb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84042024-11-18T21:08:57.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a5edf32-ed32-4e80-b756-f5ae5a9ecadb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84052024-11-18T21:08:57.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a5edf32-ed32-4e80-b756-f5ae5a9ecadb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84062024-11-18T21:08:58.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 025e2d99-10b0-4a4d-abf6-8247a313c056 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84072024-11-18T21:08:58.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 025e2d99-10b0-4a4d-abf6-8247a313c056 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84082024-11-18T21:08:58.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 025e2d99-10b0-4a4d-abf6-8247a313c056 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84092024-11-18T21:08:59.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e501dc87-07a9-42e2-83f8-b71a4e56f32a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84102024-11-18T21:08:59.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e501dc87-07a9-42e2-83f8-b71a4e56f32a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84112024-11-18T21:08:59.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e501dc87-07a9-42e2-83f8-b71a4e56f32a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84122024-11-18T21:09:00.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53f41f9c-0474-46a9-8e26-e7492095abfe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84132024-11-18T21:09:00.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53f41f9c-0474-46a9-8e26-e7492095abfe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84142024-11-18T21:09:01.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53f41f9c-0474-46a9-8e26-e7492095abfe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84152024-11-18T21:09:02.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8886ac68-7d60-486c-b900-9ceb950bbc8c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84162024-11-18T21:09:02.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8886ac68-7d60-486c-b900-9ceb950bbc8c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84172024-11-18T21:09:02.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8886ac68-7d60-486c-b900-9ceb950bbc8c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84182024-11-18T21:09:03.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4b1c3dc-790e-4897-976c-ce50389470f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84192024-11-18T21:09:03.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4b1c3dc-790e-4897-976c-ce50389470f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84202024-11-18T21:09:03.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4b1c3dc-790e-4897-976c-ce50389470f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84212024-11-18T21:09:04.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56fafa89-a3dd-4c20-97db-89e78680c4aa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84222024-11-18T21:09:04.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56fafa89-a3dd-4c20-97db-89e78680c4aa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84232024-11-18T21:09:04.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 56fafa89-a3dd-4c20-97db-89e78680c4aa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84242024-11-18T21:09:05.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82e9304b-5d1e-4f5e-bb70-94e42c80b52c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84252024-11-18T21:09:05.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82e9304b-5d1e-4f5e-bb70-94e42c80b52c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84262024-11-18T21:09:05.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82e9304b-5d1e-4f5e-bb70-94e42c80b52c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84272024-11-18T21:09:05.876ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = d5c7dc0a-fa3f-4c24-8264-cec8bb98e740 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
84282024-11-18T21:09:06.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c27ba985-b95f-4019-94b2-ab6af8b6b715 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84292024-11-18T21:09:06.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c27ba985-b95f-4019-94b2-ab6af8b6b715 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84302024-11-18T21:09:06.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c27ba985-b95f-4019-94b2-ab6af8b6b715 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
84312024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
84322024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
84332024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84342024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84352024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
84362024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84372024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
84382024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84392024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
84402024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84412024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
84422024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84432024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
84442024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
84452024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
84462024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
84472024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84482024-11-18T21:09:06.241ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 20:59:06.241570853 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
84492024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84502024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
84512024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
84522024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84532024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
84542024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
84552024-11-18T21:09:06.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84562024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
84572024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84582024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84592024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
84602024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84612024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
84622024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
84632024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84642024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
84652024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84662024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
84672024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84682024-11-18T21:09:06.241ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84692024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84702024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
84712024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84722024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
84732024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
84742024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84752024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
84762024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84772024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
84782024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
84792024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84802024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84812024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84822024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
84832024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84842024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
84852024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84862024-11-18T21:09:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84872024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
84882024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
84892024-11-18T21:09:06.242ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
84902024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84912024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.83\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
84922024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
84932024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84942024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84952024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84962024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84972024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84982024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84992024-11-18T21:09:06.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 554717862 } })
85002024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
85012024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85022024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85032024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85042024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85052024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85062024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85072024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85082024-11-18T21:09:06.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 554859003 } })
85092024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85102024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85112024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85122024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85132024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85142024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85152024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85162024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85172024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85182024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85192024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
85202024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.30576ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
85212024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
85222024-11-18T21:09:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.3656ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
85232024-11-18T21:09:06.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85242024-11-18T21:09:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85252024-11-18T21:09:06.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85262024-11-18T21:09:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85272024-11-18T21:09:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85282024-11-18T21:09:06.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 557633874 } })
85292024-11-18T21:09:06.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
85302024-11-18T21:09:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.869919ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85312024-11-18T21:09:06.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85322024-11-18T21:09:06.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85332024-11-18T21:09:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85342024-11-18T21:09:06.249ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 20:59:06.241570853 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85352024-11-18T21:09:06.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.667947ms iteration = 9 status = {"expiration":"2024-11-18T20:59:06.241570853Z","pruned":[]}
85362024-11-18T21:09:06.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 562307919 } })
85372024-11-18T21:09:06.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
85382024-11-18T21:09:06.250ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.068418ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
85392024-11-18T21:09:06.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85402024-11-18T21:09:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85412024-11-18T21:09:06.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85422024-11-18T21:09:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85432024-11-18T21:09:06.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442024-11-18T21:09:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85452024-11-18T21:09:06.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85462024-11-18T21:09:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85472024-11-18T21:09:06.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85482024-11-18T21:09:06.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85492024-11-18T21:09:06.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85502024-11-18T21:09:06.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85512024-11-18T21:09:06.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85522024-11-18T21:09:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85532024-11-18T21:09:06.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85542024-11-18T21:09:06.297ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85552024-11-18T21:09:06.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85562024-11-18T21:09:06.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85572024-11-18T21:09:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85582024-11-18T21:09:06.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85592024-11-18T21:09:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85602024-11-18T21:09:06.300ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85612024-11-18T21:09:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85622024-11-18T21:09:06.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85632024-11-18T21:09:06.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85642024-11-18T21:09:06.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652024-11-18T21:09:06.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.3012ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
85662024-11-18T21:09:06.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85672024-11-18T21:09:06.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85682024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85692024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85702024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85712024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85722024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85732024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85742024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85752024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85762024-11-18T21:09:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85772024-11-18T21:09:06.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85782024-11-18T21:09:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85792024-11-18T21:09:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85802024-11-18T21:09:06.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.240279ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85812024-11-18T21:09:06.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85822024-11-18T21:09:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85832024-11-18T21:09:06.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.438428ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
85842024-11-18T21:09:06.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1455, tv_nsec: 624891896 } })
85852024-11-18T21:09:06.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85862024-11-18T21:09:06.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
85872024-11-18T21:09:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85882024-11-18T21:09:06.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.300031ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85892024-11-18T21:09:06.313ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85902024-11-18T21:09:06.313ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85912024-11-18T21:09:06.313ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.287031ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85922024-11-18T21:09:06.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-11-18T21:09:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85942024-11-18T21:09:06.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85952024-11-18T21:09:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85962024-11-18T21:09:06.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85972024-11-18T21:09:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85982024-11-18T21:09:06.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992024-11-18T21:09:06.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002024-11-18T21:09:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86012024-11-18T21:09:06.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86022024-11-18T21:09:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86032024-11-18T21:09:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86042024-11-18T21:09:06.327ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86052024-11-18T21:09:06.327ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86062024-11-18T21:09:06.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86072024-11-18T21:09:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86082024-11-18T21:09:06.328ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86092024-11-18T21:09:06.328ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86102024-11-18T21:09:06.328ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86112024-11-18T21:09:06.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86122024-11-18T21:09:06.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86132024-11-18T21:09:06.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86142024-11-18T21:09:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86152024-11-18T21:09:06.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86162024-11-18T21:09:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86172024-11-18T21:09:06.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86182024-11-18T21:09:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86192024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86202024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86212024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86222024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86232024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86242024-11-18T21:09:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86252024-11-18T21:09:06.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86262024-11-18T21:09:06.342ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272024-11-18T21:09:06.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86282024-11-18T21:09:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
86292024-11-18T21:09:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86302024-11-18T21:09:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86312024-11-18T21:09:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
86322024-11-18T21:09:06.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86332024-11-18T21:09:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86342024-11-18T21:09:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86352024-11-18T21:09:06.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86362024-11-18T21:09:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86372024-11-18T21:09:06.351ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.622257ms iteration = 17 status = 0
86382024-11-18T21:09:06.353ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
86392024-11-18T21:09:06.353ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86402024-11-18T21:09:06.353ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
86412024-11-18T21:09:06.353ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 111.779054ms iteration = 9 status = {"generation":1}
86422024-11-18T21:09:06.356ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86432024-11-18T21:09:06.356ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86442024-11-18T21:09:06.356ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.766996ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86452024-11-18T21:09:06.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86462024-11-18T21:09:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86472024-11-18T21:09:06.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482024-11-18T21:09:06.364ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86492024-11-18T21:09:06.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86502024-11-18T21:09:06.365ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86512024-11-18T21:09:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.847124ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86522024-11-18T21:09:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86532024-11-18T21:09:06.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86542024-11-18T21:09:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86552024-11-18T21:09:06.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.176731ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86562024-11-18T21:09:06.377ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86572024-11-18T21:09:06.377ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86582024-11-18T21:09:06.377ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86592024-11-18T21:09:06.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86602024-11-18T21:09:06.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86612024-11-18T21:09:06.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86622024-11-18T21:09:06.379ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86632024-11-18T21:09:06.379ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86642024-11-18T21:09:06.379ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86652024-11-18T21:09:06.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86662024-11-18T21:09:06.381ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
86672024-11-18T21:09:06.381ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.136245ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
86682024-11-18T21:09:06.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86692024-11-18T21:09:06.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86702024-11-18T21:09:06.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86712024-11-18T21:09:06.383ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86722024-11-18T21:09:06.383ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86732024-11-18T21:09:06.383ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.214883ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86742024-11-18T21:09:06.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86752024-11-18T21:09:06.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86762024-11-18T21:09:06.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.397636ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86772024-11-18T21:09:06.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86782024-11-18T21:09:06.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86792024-11-18T21:09:06.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86802024-11-18T21:09:06.415ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86812024-11-18T21:09:06.415ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
86822024-11-18T21:09:06.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86832024-11-18T21:09:06.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86842024-11-18T21:09:06.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86852024-11-18T21:09:06.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86862024-11-18T21:09:06.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86872024-11-18T21:09:06.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86882024-11-18T21:09:06.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86892024-11-18T21:09:06.418ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86902024-11-18T21:09:06.418ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53af1964-5067-487f-b9d1-957063e489ee", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
86912024-11-18T21:09:06.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86922024-11-18T21:09:06.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86932024-11-18T21:09:06.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86942024-11-18T21:09:06.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86952024-11-18T21:09:06.420ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86962024-11-18T21:09:06.430ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.834449ms iteration = 19 status = {"physical_disks_added":0}
86972024-11-18T21:09:06.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86982024-11-18T21:09:06.430ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86992024-11-18T21:09:06.430ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5d1eec0-c1d9-4bfb-a6cd-8b4760a4ab63", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87002024-11-18T21:09:06.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87012024-11-18T21:09:06.432ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87022024-11-18T21:09:06.479ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
87032024-11-18T21:09:06.479ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 238.002416ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
87042024-11-18T21:09:06.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87052024-11-18T21:09:06.492ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
87062024-11-18T21:09:06.492ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87072024-11-18T21:09:06.493ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a69a56a-e813-468a-a193-e39df0e9ab6a", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87082024-11-18T21:09:06.493ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87092024-11-18T21:09:06.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
87102024-11-18T21:09:06.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87112024-11-18T21:09:06.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87122024-11-18T21:09:06.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87132024-11-18T21:09:06.594ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87142024-11-18T21:09:06.594ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87152024-11-18T21:09:06.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87162024-11-18T21:09:06.597ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
87172024-11-18T21:09:06.597ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
87182024-11-18T21:09:06.597ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
87192024-11-18T21:09:06.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 356.136246ms iteration = 9 status = {"generation":2}
87202024-11-18T21:09:06.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87212024-11-18T21:09:06.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87222024-11-18T21:09:06.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87232024-11-18T21:09:06.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87242024-11-18T21:09:06.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87252024-11-18T21:09:06.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87262024-11-18T21:09:06.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87272024-11-18T21:09:06.631ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
87282024-11-18T21:09:06.631ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 390.522103ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87292024-11-18T21:09:06.678ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d85fa37-d007-42dc-afdb-78445d191985", "content-length": "372", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87302024-11-18T21:09:06.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87312024-11-18T21:09:06.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87322024-11-18T21:09:06.717ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87332024-11-18T21:09:06.717ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c351f9dc-5b3a-4cd0-a8ed-97d387c3d327", "content-length": "1", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} })
87342024-11-18T21:09:06.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87352024-11-18T21:09:06.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87362024-11-18T21:09:06.720ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 479.166044ms iteration = 17 status = null
87372024-11-18T21:09:06.724ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87382024-11-18T21:09:06.724ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87392024-11-18T21:09:06.725ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "071cf754-bc8c-44b4-898c-b00fa1df3a56", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87402024-11-18T21:09:06.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87412024-11-18T21:09:06.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87422024-11-18T21:09:06.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87432024-11-18T21:09:06.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87442024-11-18T21:09:06.730ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 489.320489ms iteration = 17 status = {}
87452024-11-18T21:09:06.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87462024-11-18T21:09:06.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87472024-11-18T21:09:06.774ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8ee9c25c-4b1c-4617-a80e-a28a0f25c7f8", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87482024-11-18T21:09:06.774ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87492024-11-18T21:09:06.776ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "068211a7-d534-4878-8393-f1910450b676", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87502024-11-18T21:09:06.776ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87512024-11-18T21:09:06.778ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87522024-11-18T21:09:06.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 537.013785ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87532024-11-18T21:09:06.793ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87542024-11-18T21:09:06.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "817c018b-649f-4051-b251-9a7b672c1b83", "content-length": "691", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87552024-11-18T21:09:06.793ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87562024-11-18T21:09:06.793ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87572024-11-18T21:09:06.793ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87582024-11-18T21:09:06.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.53063ms iteration = 17 status = {}
87592024-11-18T21:09:06.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87602024-11-18T21:09:06.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87612024-11-18T21:09:06.799ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87622024-11-18T21:09:06.799ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87632024-11-18T21:09:06.799ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "732b6839-799c-4736-9f46-18a1f68a4ae8", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
87642024-11-18T21:09:06.801ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 560.053067ms iteration = 17 status = {}
87652024-11-18T21:09:06.842ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
87662024-11-18T21:09:06.842ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3cc8b3e4-f82e-45ac-a60d-24085c0b0223", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87672024-11-18T21:09:06.842ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87682024-11-18T21:09:06.844ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0193e778-1b35-4516-8ff9-30f21f444110", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87692024-11-18T21:09:06.844ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87702024-11-18T21:09:06.846ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d9c38cb8-1505-4f06-81c3-a7cde966c07c", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87712024-11-18T21:09:06.846ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87722024-11-18T21:09:06.848ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
87732024-11-18T21:09:06.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 607.380859ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
87742024-11-18T21:09:06.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87752024-11-18T21:09:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87762024-11-18T21:09:06.852ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
87772024-11-18T21:09:06.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87782024-11-18T21:09:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87792024-11-18T21:09:06.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87802024-11-18T21:09:06.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "42bebb28-c78e-40ee-8fc0-73efd2119432", "content-length": "134", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} })
87812024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87822024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
87832024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87842024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87852024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87862024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87872024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87882024-11-18T21:09:06.861ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87892024-11-18T21:09:06.862ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87902024-11-18T21:09:06.862ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87912024-11-18T21:09:06.862ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
87922024-11-18T21:09:06.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87932024-11-18T21:09:06.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87942024-11-18T21:09:06.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87952024-11-18T21:09:06.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0a99ac2-301b-4c52-bba7-dce9fd8a20ee", "content-length": "2", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} })
87962024-11-18T21:09:06.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87972024-11-18T21:09:06.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2e00ce2-580d-4592-a991-0756d844c4b5", "content-length": "51", "date": "Mon, 18 Nov 2024 21:09:05 GMT"} })
87982024-11-18T21:09:06.864ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
87992024-11-18T21:09:06.864ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88002024-11-18T21:09:06.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11730c12-d890-4179-8d03-2cbd5d7a36b4", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
88012024-11-18T21:09:06.961ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
88022024-11-18T21:09:06.961ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88032024-11-18T21:09:06.962ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "219e6ea6-1a58-4dac-866d-68635c827c99", "content-length": "682", "date": "Mon, 18 Nov 2024 21:09:06 GMT"} })
88042024-11-18T21:09:06.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88052024-11-18T21:09:06.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88062024-11-18T21:09:06.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88072024-11-18T21:09:06.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88082024-11-18T21:09:06.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88092024-11-18T21:09:06.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88102024-11-18T21:09:06.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88112024-11-18T21:09:06.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88122024-11-18T21:09:06.979ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 737.595101ms iteration = 17 status = {}
88132024-11-18T21:09:07.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1477df48-78b3-401f-81de-c3437af0d065 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88142024-11-18T21:09:07.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1477df48-78b3-401f-81de-c3437af0d065 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88152024-11-18T21:09:07.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1477df48-78b3-401f-81de-c3437af0d065 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88162024-11-18T21:09:08.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = de43a75e-4f4f-4038-bb6c-9814e5dc9e80 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88172024-11-18T21:09:08.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = de43a75e-4f4f-4038-bb6c-9814e5dc9e80 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88182024-11-18T21:09:08.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = de43a75e-4f4f-4038-bb6c-9814e5dc9e80 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88192024-11-18T21:09:09.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 17189d45-333f-442a-a2d9-b6b9a3569db0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88202024-11-18T21:09:09.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 17189d45-333f-442a-a2d9-b6b9a3569db0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88212024-11-18T21:09:09.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 17189d45-333f-442a-a2d9-b6b9a3569db0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88222024-11-18T21:09:10.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb7a227-ae84-4de2-9c7f-fc8612e5e644 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88232024-11-18T21:09:10.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb7a227-ae84-4de2-9c7f-fc8612e5e644 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88242024-11-18T21:09:10.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb7a227-ae84-4de2-9c7f-fc8612e5e644 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88252024-11-18T21:09:11.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70ab97f1-e487-4405-8993-803aae602f2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88262024-11-18T21:09:11.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70ab97f1-e487-4405-8993-803aae602f2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88272024-11-18T21:09:11.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 70ab97f1-e487-4405-8993-803aae602f2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88282024-11-18T21:09:12.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 28fa0445-53e6-4d55-a876-7e0eb6fa0d05 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88292024-11-18T21:09:12.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 28fa0445-53e6-4d55-a876-7e0eb6fa0d05 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88302024-11-18T21:09:12.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 28fa0445-53e6-4d55-a876-7e0eb6fa0d05 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88312024-11-18T21:09:13.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65367d05-5aa3-44d1-b07b-fc64165832c9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88322024-11-18T21:09:13.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65367d05-5aa3-44d1-b07b-fc64165832c9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88332024-11-18T21:09:13.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65367d05-5aa3-44d1-b07b-fc64165832c9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88342024-11-18T21:09:14.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 149a8fc9-db6c-4664-b708-1c84b95a8eb7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88352024-11-18T21:09:14.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 149a8fc9-db6c-4664-b708-1c84b95a8eb7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88362024-11-18T21:09:14.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 149a8fc9-db6c-4664-b708-1c84b95a8eb7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88372024-11-18T21:09:15.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d496c35d-222f-436d-9f11-cf2bf9f98134 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88382024-11-18T21:09:15.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d496c35d-222f-436d-9f11-cf2bf9f98134 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88392024-11-18T21:09:15.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d496c35d-222f-436d-9f11-cf2bf9f98134 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88402024-11-18T21:09:16.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
88412024-11-18T21:09:16.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
88422024-11-18T21:09:16.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88432024-11-18T21:09:16.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88442024-11-18T21:09:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88452024-11-18T21:09:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88462024-11-18T21:09:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88472024-11-18T21:09:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88482024-11-18T21:09:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88492024-11-18T21:09:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88502024-11-18T21:09:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88512024-11-18T21:09:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88522024-11-18T21:09:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88532024-11-18T21:09:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
88542024-11-18T21:09:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88552024-11-18T21:09:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88562024-11-18T21:09:16.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
88572024-11-18T21:09:16.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.380865ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
88582024-11-18T21:09:16.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88592024-11-18T21:09:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88602024-11-18T21:09:16.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.947187ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88612024-11-18T21:09:16.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e53779f0-de4a-47e6-89ce-55b2097bf5aa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88622024-11-18T21:09:16.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e53779f0-de4a-47e6-89ce-55b2097bf5aa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88632024-11-18T21:09:16.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e53779f0-de4a-47e6-89ce-55b2097bf5aa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88642024-11-18T21:09:17.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72d32103-0ddb-41c0-993a-e16ca7cd91c5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88652024-11-18T21:09:17.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72d32103-0ddb-41c0-993a-e16ca7cd91c5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88662024-11-18T21:09:17.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72d32103-0ddb-41c0-993a-e16ca7cd91c5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88672024-11-18T21:09:18.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1eb71837-85dc-4951-b595-f43fe1649c42 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88682024-11-18T21:09:18.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1eb71837-85dc-4951-b595-f43fe1649c42 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88692024-11-18T21:09:18.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1eb71837-85dc-4951-b595-f43fe1649c42 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88702024-11-18T21:09:19.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bfabbb6f-a6a5-4906-9299-b81ac4cf13b9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88712024-11-18T21:09:19.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bfabbb6f-a6a5-4906-9299-b81ac4cf13b9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88722024-11-18T21:09:19.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bfabbb6f-a6a5-4906-9299-b81ac4cf13b9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88732024-11-18T21:09:20.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e095d3e-d4c1-4b5a-9f34-90521c5111b8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88742024-11-18T21:09:20.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e095d3e-d4c1-4b5a-9f34-90521c5111b8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88752024-11-18T21:09:20.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8e095d3e-d4c1-4b5a-9f34-90521c5111b8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88762024-11-18T21:09:20.876ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 91915562-24ef-4187-b87f-93242dc71c27 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
88772024-11-18T21:09:21.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 681b86dc-4ac7-486f-9496-ab87cfe23fab roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88782024-11-18T21:09:21.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 681b86dc-4ac7-486f-9496-ab87cfe23fab resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88792024-11-18T21:09:21.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 681b86dc-4ac7-486f-9496-ab87cfe23fab response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88802024-11-18T21:09:22.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9d8b20-e804-4ace-b8d1-d8d055f73858 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88812024-11-18T21:09:22.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9d8b20-e804-4ace-b8d1-d8d055f73858 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88822024-11-18T21:09:22.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9d8b20-e804-4ace-b8d1-d8d055f73858 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88832024-11-18T21:09:23.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fbb63d3-f465-4ffa-a01d-55cc5b8a7d0d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88842024-11-18T21:09:23.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fbb63d3-f465-4ffa-a01d-55cc5b8a7d0d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88852024-11-18T21:09:23.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fbb63d3-f465-4ffa-a01d-55cc5b8a7d0d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88862024-11-18T21:09:24.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0067267-b859-4939-84de-b20bba2910d5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88872024-11-18T21:09:24.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0067267-b859-4939-84de-b20bba2910d5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88882024-11-18T21:09:24.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0067267-b859-4939-84de-b20bba2910d5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88892024-11-18T21:09:25.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2deebca1-b3d0-4dbb-a2a9-5a2c5062a08d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88902024-11-18T21:09:25.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2deebca1-b3d0-4dbb-a2a9-5a2c5062a08d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88912024-11-18T21:09:25.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2deebca1-b3d0-4dbb-a2a9-5a2c5062a08d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
88922024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
88932024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
88942024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88952024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88962024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88972024-11-18T21:09:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88982024-11-18T21:09:26.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88992024-11-18T21:09:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89002024-11-18T21:09:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89012024-11-18T21:09:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89022024-11-18T21:09:26.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89032024-11-18T21:09:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89042024-11-18T21:09:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89052024-11-18T21:09:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
89062024-11-18T21:09:26.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89072024-11-18T21:09:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89082024-11-18T21:09:26.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
89092024-11-18T21:09:26.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.064732ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
89102024-11-18T21:09:26.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89112024-11-18T21:09:26.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89122024-11-18T21:09:26.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.946211ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89132024-11-18T21:09:26.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 133ec00f-6024-4d4c-9d09-a2032297eb12 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89142024-11-18T21:09:26.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 133ec00f-6024-4d4c-9d09-a2032297eb12 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89152024-11-18T21:09:26.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 133ec00f-6024-4d4c-9d09-a2032297eb12 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89162024-11-18T21:09:27.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f00e87d1-e407-4bec-af73-e723844ffd1e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89172024-11-18T21:09:27.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f00e87d1-e407-4bec-af73-e723844ffd1e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89182024-11-18T21:09:27.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f00e87d1-e407-4bec-af73-e723844ffd1e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89192024-11-18T21:09:28.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9bcb546-db06-40a3-af41-9e16c1b8fdd2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89202024-11-18T21:09:28.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9bcb546-db06-40a3-af41-9e16c1b8fdd2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89212024-11-18T21:09:28.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b9bcb546-db06-40a3-af41-9e16c1b8fdd2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89222024-11-18T21:09:29.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65b52480-3ceb-43cf-a1ec-057005019216 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89232024-11-18T21:09:29.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65b52480-3ceb-43cf-a1ec-057005019216 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89242024-11-18T21:09:29.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65b52480-3ceb-43cf-a1ec-057005019216 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89252024-11-18T21:09:30.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = edab36f8-f171-4901-a003-77138de0c666 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89262024-11-18T21:09:30.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = edab36f8-f171-4901-a003-77138de0c666 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89272024-11-18T21:09:30.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = edab36f8-f171-4901-a003-77138de0c666 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89282024-11-18T21:09:31.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4bb02ad0-b07e-47ac-b6b8-0135f0cb199e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89292024-11-18T21:09:31.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4bb02ad0-b07e-47ac-b6b8-0135f0cb199e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89302024-11-18T21:09:31.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4bb02ad0-b07e-47ac-b6b8-0135f0cb199e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89312024-11-18T21:09:32.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2294334-7318-42c2-94aa-f48083cf2c2b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89322024-11-18T21:09:32.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2294334-7318-42c2-94aa-f48083cf2c2b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89332024-11-18T21:09:32.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2294334-7318-42c2-94aa-f48083cf2c2b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89342024-11-18T21:09:33.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b2cd451-fca1-416d-8211-82ccdc7f1c0e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89352024-11-18T21:09:33.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b2cd451-fca1-416d-8211-82ccdc7f1c0e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89362024-11-18T21:09:33.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b2cd451-fca1-416d-8211-82ccdc7f1c0e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89372024-11-18T21:09:34.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e782a0a2-c1ac-439d-bccc-02bf861862e9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89382024-11-18T21:09:34.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e782a0a2-c1ac-439d-bccc-02bf861862e9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89392024-11-18T21:09:34.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e782a0a2-c1ac-439d-bccc-02bf861862e9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89402024-11-18T21:09:35.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2622969e-f714-4990-b288-436edf5d8a39 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89412024-11-18T21:09:35.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2622969e-f714-4990-b288-436edf5d8a39 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89422024-11-18T21:09:35.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2622969e-f714-4990-b288-436edf5d8a39 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
89432024-11-18T21:09:35.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 8c575da6-a10c-4176-acef-bd8335378cf1 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
89442024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
89452024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
89462024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89472024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89482024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89492024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89502024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
89512024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
89522024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89532024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
89542024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89552024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89562024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
89572024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89582024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
89592024-11-18T21:09:36.241ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89602024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89612024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
89622024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
89632024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89642024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
89652024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89662024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89672024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
89682024-11-18T21:09:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89692024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
89702024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
89712024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89722024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89732024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
89742024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89752024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
89762024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
89772024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89782024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89792024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
89802024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89812024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89822024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89832024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89842024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89852024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89862024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89872024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89882024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89892024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89902024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89912024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89922024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89932024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89942024-11-18T21:09:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89952024-11-18T21:09:36.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 556797328 } })
89962024-11-18T21:09:36.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 556970759 } })
89972024-11-18T21:09:36.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
89982024-11-18T21:09:36.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
89992024-11-18T21:09:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002024-11-18T21:09:36.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.521074ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90012024-11-18T21:09:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90022024-11-18T21:09:36.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90032024-11-18T21:09:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90042024-11-18T21:09:36.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052024-11-18T21:09:36.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90062024-11-18T21:09:36.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072024-11-18T21:09:36.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90082024-11-18T21:09:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90092024-11-18T21:09:36.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90102024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90112024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90122024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90132024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90142024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90152024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90162024-11-18T21:09:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90172024-11-18T21:09:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90182024-11-18T21:09:36.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90192024-11-18T21:09:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90202024-11-18T21:09:36.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1485, tv_nsec: 571414087 } })
90212024-11-18T21:09:36.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90222024-11-18T21:09:36.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90232024-11-18T21:09:36.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
90242024-11-18T21:09:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90252024-11-18T21:09:36.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90262024-11-18T21:09:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90272024-11-18T21:09:36.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90282024-11-18T21:09:36.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90292024-11-18T21:09:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90302024-11-18T21:09:36.280ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90312024-11-18T21:09:36.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90322024-11-18T21:09:36.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.003423ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
90332024-11-18T21:09:36.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90342024-11-18T21:09:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90352024-11-18T21:09:36.294ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90362024-11-18T21:09:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90372024-11-18T21:09:36.296ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90382024-11-18T21:09:36.296ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90392024-11-18T21:09:36.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90402024-11-18T21:09:36.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90412024-11-18T21:09:36.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90422024-11-18T21:09:36.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90432024-11-18T21:09:36.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90442024-11-18T21:09:36.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90452024-11-18T21:09:36.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
90462024-11-18T21:09:36.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90472024-11-18T21:09:36.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90482024-11-18T21:09:36.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.052418ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90492024-11-18T21:09:36.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90502024-11-18T21:09:36.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90512024-11-18T21:09:36.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90522024-11-18T21:09:36.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90532024-11-18T21:09:36.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90542024-11-18T21:09:36.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.424515ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
90552024-11-18T21:09:36.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90562024-11-18T21:09:36.310ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90572024-11-18T21:09:36.311ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.969245ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90582024-11-18T21:09:36.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90592024-11-18T21:09:36.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90602024-11-18T21:09:36.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90612024-11-18T21:09:36.319ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
90622024-11-18T21:09:36.319ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.567978ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
90632024-11-18T21:09:36.325ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90642024-11-18T21:09:36.325ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90652024-11-18T21:09:36.325ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21d46b9b-28ca-405c-b0e5-789e9b689f75", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
90662024-11-18T21:09:36.325ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90672024-11-18T21:09:36.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90682024-11-18T21:09:36.328ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90692024-11-18T21:09:36.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.725447ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90702024-11-18T21:09:36.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90712024-11-18T21:09:36.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90722024-11-18T21:09:36.329ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90732024-11-18T21:09:36.329ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a97c726-d87c-41be-b60e-cd2c2447cc24", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
90742024-11-18T21:09:36.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90752024-11-18T21:09:36.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90762024-11-18T21:09:36.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90772024-11-18T21:09:36.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90782024-11-18T21:09:36.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90792024-11-18T21:09:36.336ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90802024-11-18T21:09:36.336ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90812024-11-18T21:09:36.336ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90822024-11-18T21:09:36.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90832024-11-18T21:09:36.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90842024-11-18T21:09:36.337ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852024-11-18T21:09:36.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.036524ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90862024-11-18T21:09:36.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
90872024-11-18T21:09:36.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90882024-11-18T21:09:36.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90892024-11-18T21:09:36.342ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.700902ms iteration = 18 status = 0
90902024-11-18T21:09:36.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
90912024-11-18T21:09:36.344ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90922024-11-18T21:09:36.345ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0cd9941-65c4-42c1-9146-a30e3963f2a8", "content-length": "26", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
90932024-11-18T21:09:36.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90942024-11-18T21:09:36.349ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
90952024-11-18T21:09:36.354ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.469918ms iteration = 20 status = {"physical_disks_added":0}
90962024-11-18T21:09:36.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.035065ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90972024-11-18T21:09:36.370ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90982024-11-18T21:09:36.370ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90992024-11-18T21:09:36.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.171756ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91002024-11-18T21:09:36.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91012024-11-18T21:09:36.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91022024-11-18T21:09:36.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91032024-11-18T21:09:36.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91042024-11-18T21:09:36.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91052024-11-18T21:09:36.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91062024-11-18T21:09:36.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91072024-11-18T21:09:36.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91082024-11-18T21:09:36.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91092024-11-18T21:09:36.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91102024-11-18T21:09:36.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91112024-11-18T21:09:36.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91122024-11-18T21:09:36.417ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.67257ms iteration = 18 status = {}
91132024-11-18T21:09:36.420ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91142024-11-18T21:09:36.420ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e462fc20-22e7-4673-8645-ee9105e3f9d3", "content-length": "1", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
91152024-11-18T21:09:36.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91162024-11-18T21:09:36.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91172024-11-18T21:09:36.424ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.870754ms iteration = 18 status = null
91182024-11-18T21:09:36.432ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91192024-11-18T21:09:36.432ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91202024-11-18T21:09:36.433ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5363967-b077-4549-989b-b1a93d94ba10", "content-length": "372", "date": "Mon, 18 Nov 2024 21:09:35 GMT"} })
91212024-11-18T21:09:36.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91222024-11-18T21:09:36.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91232024-11-18T21:09:36.448ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
91242024-11-18T21:09:36.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91252024-11-18T21:09:36.448ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "256025e9-bad8-4896-9e42-2ab55405ac50", "date": "Mon, 18 Nov 2024 21:09:35 GMT"} })
91262024-11-18T21:09:36.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91272024-11-18T21:09:36.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91282024-11-18T21:09:36.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91292024-11-18T21:09:36.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91302024-11-18T21:09:36.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91312024-11-18T21:09:36.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91322024-11-18T21:09:36.458ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91332024-11-18T21:09:36.458ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91342024-11-18T21:09:36.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8fcf63e3-4e5f-4715-9c16-efb65d5cb240", "date": "Mon, 18 Nov 2024 21:09:35 GMT"} })
91352024-11-18T21:09:36.459ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 217.944165ms iteration = 18 status = {}
91362024-11-18T21:09:36.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91372024-11-18T21:09:36.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91382024-11-18T21:09:36.525ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
91392024-11-18T21:09:36.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91402024-11-18T21:09:36.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91412024-11-18T21:09:36.532ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91422024-11-18T21:09:36.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91432024-11-18T21:09:36.535ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f90710b0-5d7b-44fd-a8f6-f51044f6c58c", "content-length": "134", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
91442024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91452024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
91462024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91472024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91482024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91492024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91502024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91512024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91522024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91532024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91542024-11-18T21:09:36.535ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
91552024-11-18T21:09:36.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91562024-11-18T21:09:36.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91572024-11-18T21:09:36.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91582024-11-18T21:09:36.538ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "36b3cc8d-4a2b-4d79-b175-d14497e064da", "content-length": "2", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
91592024-11-18T21:09:36.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91602024-11-18T21:09:36.538ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0134e15-ffb3-4c93-aa68-b07320cb1bf8", "content-length": "51", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
91612024-11-18T21:09:36.538ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
91622024-11-18T21:09:36.538ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91632024-11-18T21:09:36.571ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8085474a-7db8-479f-a752-676ea11dab26", "content-length": "691", "date": "Mon, 18 Nov 2024 21:09:35 GMT"} })
91642024-11-18T21:09:36.571ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91652024-11-18T21:09:36.571ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91662024-11-18T21:09:36.571ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91672024-11-18T21:09:36.573ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.460182ms iteration = 18 status = {}
91682024-11-18T21:09:36.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8dd25409-a21c-474f-a7d0-10011b42d82a", "date": "Mon, 18 Nov 2024 21:09:36 GMT"} })
91692024-11-18T21:09:36.659ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
91702024-11-18T21:09:36.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91712024-11-18T21:09:36.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "18d551ab-883f-40e4-8552-92f4d5b42a71", "content-length": "682", "date": "Mon, 18 Nov 2024 21:09:35 GMT"} })
91722024-11-18T21:09:36.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91732024-11-18T21:09:36.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91742024-11-18T21:09:36.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91752024-11-18T21:09:36.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91762024-11-18T21:09:36.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91772024-11-18T21:09:36.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91782024-11-18T21:09:36.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91792024-11-18T21:09:36.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91802024-11-18T21:09:36.675ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.909466ms iteration = 18 status = {}
91812024-11-18T21:09:36.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa3475df-04f2-482b-a343-647c13cc286b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91822024-11-18T21:09:36.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa3475df-04f2-482b-a343-647c13cc286b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91832024-11-18T21:09:36.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa3475df-04f2-482b-a343-647c13cc286b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91842024-11-18T21:09:37.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fcf59b43-7168-4b33-9eff-f429179944d5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91852024-11-18T21:09:37.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fcf59b43-7168-4b33-9eff-f429179944d5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91862024-11-18T21:09:37.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fcf59b43-7168-4b33-9eff-f429179944d5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91872024-11-18T21:09:38.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f162b4b-ef19-4466-b094-cf29e5d1e11b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91882024-11-18T21:09:38.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f162b4b-ef19-4466-b094-cf29e5d1e11b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91892024-11-18T21:09:38.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f162b4b-ef19-4466-b094-cf29e5d1e11b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91902024-11-18T21:09:39.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1aa9d802-1ad4-47a1-a99f-e756daee7906 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91912024-11-18T21:09:39.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1aa9d802-1ad4-47a1-a99f-e756daee7906 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91922024-11-18T21:09:39.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1aa9d802-1ad4-47a1-a99f-e756daee7906 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91932024-11-18T21:09:40.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5dfd86aa-81fa-419a-8dfc-6fc820834274 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91942024-11-18T21:09:40.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5dfd86aa-81fa-419a-8dfc-6fc820834274 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91952024-11-18T21:09:40.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5dfd86aa-81fa-419a-8dfc-6fc820834274 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91962024-11-18T21:09:41.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9dd7be-13be-412b-a854-0a2d783d3c83 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91972024-11-18T21:09:41.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9dd7be-13be-412b-a854-0a2d783d3c83 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91982024-11-18T21:09:41.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0f9dd7be-13be-412b-a854-0a2d783d3c83 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
91992024-11-18T21:09:42.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41bcad03-d4ec-493d-b052-0bacfa92b3fa roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92002024-11-18T21:09:42.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41bcad03-d4ec-493d-b052-0bacfa92b3fa resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92012024-11-18T21:09:42.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41bcad03-d4ec-493d-b052-0bacfa92b3fa response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92022024-11-18T21:09:44.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a3415c1-d8c0-4a43-9696-86ded5e7a874 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92032024-11-18T21:09:44.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a3415c1-d8c0-4a43-9696-86ded5e7a874 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92042024-11-18T21:09:44.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3a3415c1-d8c0-4a43-9696-86ded5e7a874 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92052024-11-18T21:09:45.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c04b52c1-0314-4b11-8b33-94eeca079566 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92062024-11-18T21:09:45.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c04b52c1-0314-4b11-8b33-94eeca079566 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92072024-11-18T21:09:45.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c04b52c1-0314-4b11-8b33-94eeca079566 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92082024-11-18T21:09:46.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c765ba7-9b95-4051-b1cd-8875a6eb848c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92092024-11-18T21:09:46.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c765ba7-9b95-4051-b1cd-8875a6eb848c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92102024-11-18T21:09:46.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c765ba7-9b95-4051-b1cd-8875a6eb848c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92112024-11-18T21:09:46.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
92122024-11-18T21:09:46.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92132024-11-18T21:09:46.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
92142024-11-18T21:09:46.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92152024-11-18T21:09:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92162024-11-18T21:09:46.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92172024-11-18T21:09:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92182024-11-18T21:09:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92192024-11-18T21:09:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92202024-11-18T21:09:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92212024-11-18T21:09:46.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92222024-11-18T21:09:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92232024-11-18T21:09:46.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92242024-11-18T21:09:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
92252024-11-18T21:09:46.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92262024-11-18T21:09:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92272024-11-18T21:09:46.269ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
92282024-11-18T21:09:46.269ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.318806ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
92292024-11-18T21:09:46.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92302024-11-18T21:09:46.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92312024-11-18T21:09:46.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.721998ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92322024-11-18T21:09:47.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2ff511d-b32e-4d79-b89c-b0900946ca6a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92332024-11-18T21:09:47.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2ff511d-b32e-4d79-b89c-b0900946ca6a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92342024-11-18T21:09:47.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2ff511d-b32e-4d79-b89c-b0900946ca6a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92352024-11-18T21:09:48.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 63916cec-454b-4777-be9e-ebea06e23df8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92362024-11-18T21:09:48.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 63916cec-454b-4777-be9e-ebea06e23df8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92372024-11-18T21:09:48.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 63916cec-454b-4777-be9e-ebea06e23df8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92382024-11-18T21:09:49.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c560ccc2-9738-4508-bb9f-7cce18b89ce7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92392024-11-18T21:09:49.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c560ccc2-9738-4508-bb9f-7cce18b89ce7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92402024-11-18T21:09:49.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c560ccc2-9738-4508-bb9f-7cce18b89ce7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92412024-11-18T21:09:50.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f66df8da-869e-4f25-9deb-e0fd10b58eab roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92422024-11-18T21:09:50.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f66df8da-869e-4f25-9deb-e0fd10b58eab resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92432024-11-18T21:09:50.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f66df8da-869e-4f25-9deb-e0fd10b58eab response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92442024-11-18T21:09:50.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 725 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 4c84a91e-75b4-4dda-aa2d-35a6b58e4c2e response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
92452024-11-18T21:09:51.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc0063a5-31bf-414c-b74f-76c82855b0c3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92462024-11-18T21:09:51.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc0063a5-31bf-414c-b74f-76c82855b0c3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92472024-11-18T21:09:51.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dc0063a5-31bf-414c-b74f-76c82855b0c3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92482024-11-18T21:09:52.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 653b0543-db8c-4406-9d2e-223bba3618f5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92492024-11-18T21:09:52.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 653b0543-db8c-4406-9d2e-223bba3618f5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92502024-11-18T21:09:52.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 653b0543-db8c-4406-9d2e-223bba3618f5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92512024-11-18T21:09:53.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f9d315-67db-4933-a8ee-2222f805547b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92522024-11-18T21:09:53.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f9d315-67db-4933-a8ee-2222f805547b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92532024-11-18T21:09:53.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10f9d315-67db-4933-a8ee-2222f805547b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92542024-11-18T21:09:54.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f14d84ad-c005-427d-aa5e-6806ebdaecab roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92552024-11-18T21:09:54.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f14d84ad-c005-427d-aa5e-6806ebdaecab resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92562024-11-18T21:09:54.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f14d84ad-c005-427d-aa5e-6806ebdaecab response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92572024-11-18T21:09:55.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 937d6e46-71ed-4f23-a190-fa0b336e79e8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92582024-11-18T21:09:55.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 937d6e46-71ed-4f23-a190-fa0b336e79e8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92592024-11-18T21:09:55.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 937d6e46-71ed-4f23-a190-fa0b336e79e8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92602024-11-18T21:09:56.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
92612024-11-18T21:09:56.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
92622024-11-18T21:09:56.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92632024-11-18T21:09:56.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92642024-11-18T21:09:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92652024-11-18T21:09:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92662024-11-18T21:09:56.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92672024-11-18T21:09:56.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92682024-11-18T21:09:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92692024-11-18T21:09:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92702024-11-18T21:09:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92712024-11-18T21:09:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92722024-11-18T21:09:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92732024-11-18T21:09:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92742024-11-18T21:09:56.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92752024-11-18T21:09:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
92762024-11-18T21:09:56.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92772024-11-18T21:09:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92782024-11-18T21:09:56.268ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
92792024-11-18T21:09:56.268ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.075535ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
92802024-11-18T21:09:56.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.636873ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92812024-11-18T21:09:56.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07849a86-b0ec-4083-bb42-6705607bd6e0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92822024-11-18T21:09:56.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07849a86-b0ec-4083-bb42-6705607bd6e0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92832024-11-18T21:09:56.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07849a86-b0ec-4083-bb42-6705607bd6e0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92842024-11-18T21:09:57.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 811d2065-250d-4034-b076-8a9b5a38c032 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92852024-11-18T21:09:57.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 811d2065-250d-4034-b076-8a9b5a38c032 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92862024-11-18T21:09:57.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 811d2065-250d-4034-b076-8a9b5a38c032 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92872024-11-18T21:09:58.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0b61481-8bc6-474b-98a5-9ae92846153a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92882024-11-18T21:09:58.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0b61481-8bc6-474b-98a5-9ae92846153a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92892024-11-18T21:09:58.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0b61481-8bc6-474b-98a5-9ae92846153a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92902024-11-18T21:09:59.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1db19d59-386d-47ae-9a78-41f63df10493 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92912024-11-18T21:09:59.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1db19d59-386d-47ae-9a78-41f63df10493 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92922024-11-18T21:09:59.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1db19d59-386d-47ae-9a78-41f63df10493 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92932024-11-18T21:10:00.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d89ae5cd-2de2-425f-94c0-8ab68a817275 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92942024-11-18T21:10:00.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d89ae5cd-2de2-425f-94c0-8ab68a817275 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92952024-11-18T21:10:00.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d89ae5cd-2de2-425f-94c0-8ab68a817275 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92962024-11-18T21:10:01.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b66fa84c-5346-4d72-8ed8-b6888c1b5654 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92972024-11-18T21:10:01.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b66fa84c-5346-4d72-8ed8-b6888c1b5654 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92982024-11-18T21:10:01.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b66fa84c-5346-4d72-8ed8-b6888c1b5654 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
92992024-11-18T21:10:02.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed12674b-7601-4c42-9c22-c51c9c31116c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93002024-11-18T21:10:02.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed12674b-7601-4c42-9c22-c51c9c31116c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93012024-11-18T21:10:02.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed12674b-7601-4c42-9c22-c51c9c31116c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93022024-11-18T21:10:03.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1489c1c9-32d0-4f1e-94a9-e7519529e493 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93032024-11-18T21:10:03.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1489c1c9-32d0-4f1e-94a9-e7519529e493 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93042024-11-18T21:10:03.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1489c1c9-32d0-4f1e-94a9-e7519529e493 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93052024-11-18T21:10:04.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b0e94cb8-9f59-44c1-928c-c2fb102ba154 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93062024-11-18T21:10:04.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b0e94cb8-9f59-44c1-928c-c2fb102ba154 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93072024-11-18T21:10:04.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b0e94cb8-9f59-44c1-928c-c2fb102ba154 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93082024-11-18T21:10:05.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeab1c92-004d-4385-a859-069d23b3dd28 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93092024-11-18T21:10:05.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeab1c92-004d-4385-a859-069d23b3dd28 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93102024-11-18T21:10:05.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeab1c92-004d-4385-a859-069d23b3dd28 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
93112024-11-18T21:10:05.875ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 37acf0b3-3682-4899-b76f-21fb6b85dad0 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
93122024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
93132024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
93142024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
93152024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
93162024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
93172024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93182024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93192024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
93202024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
93212024-11-18T21:10:06.242ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:00:06.242069801 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
93222024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
93232024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
93242024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
93252024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
93262024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93272024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93282024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
93292024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93302024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
93312024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
93322024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93332024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
93342024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
93352024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
93362024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
93372024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93382024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
93392024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93402024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
93412024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
93422024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93432024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
93442024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93452024-11-18T21:10:06.242ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
93462024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
93472024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.37\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
93482024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93492024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
93502024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
93512024-11-18T21:10:06.242ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
93522024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93532024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93542024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
93552024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93562024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
93572024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
93582024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93592024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93602024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
93612024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93622024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
93632024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
93642024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
93652024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93662024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
93672024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93682024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93692024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
93702024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93712024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
93722024-11-18T21:10:06.242ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93732024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93742024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
93752024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93762024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93772024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
93782024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93792024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93802024-11-18T21:10:06.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 554428690 } })
93812024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93822024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93832024-11-18T21:10:06.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 554584311 } })
93842024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93852024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93862024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93872024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93882024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93892024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93902024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93912024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93922024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93932024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93942024-11-18T21:10:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93952024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93962024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93972024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93982024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93992024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94002024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
94012024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94022024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94032024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94042024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
94052024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.152429ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
94062024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94072024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94082024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
94092024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.28071ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
94102024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94112024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94122024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94132024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94142024-11-18T21:10:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94152024-11-18T21:10:06.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94162024-11-18T21:10:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94172024-11-18T21:10:06.245ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:00:06.242069801 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
94182024-11-18T21:10:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.297765ms iteration = 10 status = {"expiration":"2024-11-18T21:00:06.242069801Z","pruned":[]}
94192024-11-18T21:10:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.849899ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94202024-11-18T21:10:06.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94212024-11-18T21:10:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94222024-11-18T21:10:06.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 559450768 } })
94232024-11-18T21:10:06.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
94242024-11-18T21:10:06.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94252024-11-18T21:10:06.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94262024-11-18T21:10:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94272024-11-18T21:10:06.249ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94282024-11-18T21:10:06.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 561486913 } })
94292024-11-18T21:10:06.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
94302024-11-18T21:10:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94312024-11-18T21:10:06.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94322024-11-18T21:10:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94332024-11-18T21:10:06.250ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.224402ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
94342024-11-18T21:10:06.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94352024-11-18T21:10:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94362024-11-18T21:10:06.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94372024-11-18T21:10:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94382024-11-18T21:10:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94392024-11-18T21:10:06.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94402024-11-18T21:10:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94412024-11-18T21:10:06.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94422024-11-18T21:10:06.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94432024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94442024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94452024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94462024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94472024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94482024-11-18T21:10:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94492024-11-18T21:10:06.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94502024-11-18T21:10:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94512024-11-18T21:10:06.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94522024-11-18T21:10:06.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94532024-11-18T21:10:06.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94542024-11-18T21:10:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94552024-11-18T21:10:06.268ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94562024-11-18T21:10:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94572024-11-18T21:10:06.272ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94582024-11-18T21:10:06.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94592024-11-18T21:10:06.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94602024-11-18T21:10:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94612024-11-18T21:10:06.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94622024-11-18T21:10:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94632024-11-18T21:10:06.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94642024-11-18T21:10:06.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94652024-11-18T21:10:06.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94662024-11-18T21:10:06.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94672024-11-18T21:10:06.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94682024-11-18T21:10:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94692024-11-18T21:10:06.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94702024-11-18T21:10:06.295ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94712024-11-18T21:10:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94722024-11-18T21:10:06.295ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94732024-11-18T21:10:06.295ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 53.552719ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94742024-11-18T21:10:06.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94752024-11-18T21:10:06.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94762024-11-18T21:10:06.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94772024-11-18T21:10:06.303ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94782024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94792024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94802024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94812024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94822024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94832024-11-18T21:10:06.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94842024-11-18T21:10:06.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94852024-11-18T21:10:06.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94862024-11-18T21:10:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94872024-11-18T21:10:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94882024-11-18T21:10:06.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94892024-11-18T21:10:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94902024-11-18T21:10:06.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94912024-11-18T21:10:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94922024-11-18T21:10:06.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94932024-11-18T21:10:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94942024-11-18T21:10:06.312ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94952024-11-18T21:10:06.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94962024-11-18T21:10:06.315ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94972024-11-18T21:10:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94982024-11-18T21:10:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94992024-11-18T21:10:06.315ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95002024-11-18T21:10:06.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95012024-11-18T21:10:06.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.199993ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
95022024-11-18T21:10:06.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-11-18T21:10:06.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
95042024-11-18T21:10:06.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95052024-11-18T21:10:06.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95062024-11-18T21:10:06.319ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
95072024-11-18T21:10:06.319ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
95082024-11-18T21:10:06.319ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.152775ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
95092024-11-18T21:10:06.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95102024-11-18T21:10:06.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95112024-11-18T21:10:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95122024-11-18T21:10:06.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.594334ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
95132024-11-18T21:10:06.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95142024-11-18T21:10:06.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.636501ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95152024-11-18T21:10:06.326ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1515, tv_nsec: 638295236 } })
95162024-11-18T21:10:06.326ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
95172024-11-18T21:10:06.327ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95182024-11-18T21:10:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
95192024-11-18T21:10:06.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95202024-11-18T21:10:06.327ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95212024-11-18T21:10:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95222024-11-18T21:10:06.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95232024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
95242024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
95252024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
95262024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95272024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
95282024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95292024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95302024-11-18T21:10:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95312024-11-18T21:10:06.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95322024-11-18T21:10:06.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.488905ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
95332024-11-18T21:10:06.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95342024-11-18T21:10:06.336ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 94.470085ms iteration = 5 status = {"nsuccess":5}
95352024-11-18T21:10:06.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95362024-11-18T21:10:06.339ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
95372024-11-18T21:10:06.339ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
95382024-11-18T21:10:06.339ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
95392024-11-18T21:10:06.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95402024-11-18T21:10:06.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95412024-11-18T21:10:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95422024-11-18T21:10:06.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95432024-11-18T21:10:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95442024-11-18T21:10:06.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95452024-11-18T21:10:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95462024-11-18T21:10:06.354ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95472024-11-18T21:10:06.354ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.935025ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95482024-11-18T21:10:06.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95492024-11-18T21:10:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95502024-11-18T21:10:06.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95512024-11-18T21:10:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95522024-11-18T21:10:06.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95532024-11-18T21:10:06.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
95542024-11-18T21:10:06.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95552024-11-18T21:10:06.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95562024-11-18T21:10:06.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95572024-11-18T21:10:06.366ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.441148ms iteration = 19 status = 0
95582024-11-18T21:10:06.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95592024-11-18T21:10:06.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95602024-11-18T21:10:06.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
95612024-11-18T21:10:06.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95622024-11-18T21:10:06.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95632024-11-18T21:10:06.370ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95642024-11-18T21:10:06.372ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95652024-11-18T21:10:06.372ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95662024-11-18T21:10:06.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95672024-11-18T21:10:06.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95682024-11-18T21:10:06.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 130.335102ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95692024-11-18T21:10:06.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
95702024-11-18T21:10:06.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95712024-11-18T21:10:06.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95722024-11-18T21:10:06.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95732024-11-18T21:10:06.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.457026ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
95742024-11-18T21:10:06.376ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95752024-11-18T21:10:06.378ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
95762024-11-18T21:10:06.378ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95772024-11-18T21:10:06.378ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87a658ec-c0a4-418b-9a77-688c8fed6107", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
95782024-11-18T21:10:06.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95792024-11-18T21:10:06.379ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95802024-11-18T21:10:06.389ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
95812024-11-18T21:10:06.389ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.572051ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
95822024-11-18T21:10:06.390ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
95832024-11-18T21:10:06.390ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95842024-11-18T21:10:06.390ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc2cea4a-23d3-438e-9909-e1fbffdff6de", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
95852024-11-18T21:10:06.390ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95862024-11-18T21:10:06.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95872024-11-18T21:10:06.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95882024-11-18T21:10:06.397ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
95892024-11-18T21:10:06.397ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
95902024-11-18T21:10:06.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95912024-11-18T21:10:06.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95922024-11-18T21:10:06.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95932024-11-18T21:10:06.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95942024-11-18T21:10:06.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95952024-11-18T21:10:06.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95962024-11-18T21:10:06.401ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
95972024-11-18T21:10:06.401ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
95982024-11-18T21:10:06.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95992024-11-18T21:10:06.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96002024-11-18T21:10:06.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96012024-11-18T21:10:06.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96022024-11-18T21:10:06.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96032024-11-18T21:10:06.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96042024-11-18T21:10:06.406ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
96052024-11-18T21:10:06.406ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
96062024-11-18T21:10:06.406ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
96072024-11-18T21:10:06.406ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 164.637127ms iteration = 10 status = {"generation":1}
96082024-11-18T21:10:06.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96092024-11-18T21:10:06.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96102024-11-18T21:10:06.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96112024-11-18T21:10:06.409ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
96122024-11-18T21:10:06.409ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
96132024-11-18T21:10:06.409ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
96142024-11-18T21:10:06.409ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 167.321558ms iteration = 10 status = {"generation":2}
96152024-11-18T21:10:06.414ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96162024-11-18T21:10:06.414ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96172024-11-18T21:10:06.414ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 171.961132ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96182024-11-18T21:10:06.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96192024-11-18T21:10:06.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96202024-11-18T21:10:06.417ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
96212024-11-18T21:10:06.417ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.276678ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
96222024-11-18T21:10:06.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96232024-11-18T21:10:06.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96242024-11-18T21:10:06.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96252024-11-18T21:10:06.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96262024-11-18T21:10:06.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96272024-11-18T21:10:06.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96282024-11-18T21:10:06.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96292024-11-18T21:10:06.428ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.162928ms iteration = 21 status = {"physical_disks_added":0}
96302024-11-18T21:10:06.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96312024-11-18T21:10:06.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96322024-11-18T21:10:06.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96332024-11-18T21:10:06.450ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
96342024-11-18T21:10:06.450ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.362494ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
96352024-11-18T21:10:06.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
96362024-11-18T21:10:06.506ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96372024-11-18T21:10:06.506ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a62b4d1-0ed7-409f-a4de-1786f59041c2", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
96382024-11-18T21:10:06.506ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96392024-11-18T21:10:06.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
96402024-11-18T21:10:06.513ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 271.313044ms iteration = 19 status = {}
96412024-11-18T21:10:06.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 934c11fb-51bf-45ce-b5b8-55fcaceaf29c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
96422024-11-18T21:10:06.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 934c11fb-51bf-45ce-b5b8-55fcaceaf29c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
96432024-11-18T21:10:06.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 934c11fb-51bf-45ce-b5b8-55fcaceaf29c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
96442024-11-18T21:10:06.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
96452024-11-18T21:10:06.595ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "03575ac9-ff5b-4b95-b4c5-3372ac213104", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
96462024-11-18T21:10:06.595ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
96472024-11-18T21:10:06.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "81c9597e-2657-47fc-b68f-4f001512543f", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
96482024-11-18T21:10:06.597ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
96492024-11-18T21:10:06.599ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
96502024-11-18T21:10:06.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 357.099143ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
96512024-11-18T21:10:06.613ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
96522024-11-18T21:10:06.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96532024-11-18T21:10:06.641ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c73b940b-b3f9-43f8-9495-4a7c320c544d", "content-length": "372", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
96542024-11-18T21:10:06.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96552024-11-18T21:10:06.641ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96562024-11-18T21:10:06.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96572024-11-18T21:10:06.641ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd395b6-7bb2-452c-b1e1-a47bafab4510", "content-length": "691", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
96582024-11-18T21:10:06.641ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
96592024-11-18T21:10:06.641ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
96602024-11-18T21:10:06.641ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
96612024-11-18T21:10:06.642ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.595138ms iteration = 19 status = {}
96622024-11-18T21:10:06.650ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
96632024-11-18T21:10:06.654ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
96642024-11-18T21:10:06.654ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
96652024-11-18T21:10:06.654ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9886cb17-3879-4b20-a38b-f06e8a43812a", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
96662024-11-18T21:10:06.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96672024-11-18T21:10:06.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96682024-11-18T21:10:06.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96692024-11-18T21:10:06.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96702024-11-18T21:10:06.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96712024-11-18T21:10:06.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96722024-11-18T21:10:06.662ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
96732024-11-18T21:10:06.662ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96742024-11-18T21:10:06.663ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3f99f2c2-8ad0-4ff2-bf8a-8b70ed8d594c", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
96752024-11-18T21:10:06.664ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 422.032328ms iteration = 19 status = {}
96762024-11-18T21:10:06.692ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
96772024-11-18T21:10:06.692ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "789fb4b1-9405-43ab-ae72-6d9f828e88fa", "content-length": "1", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
96782024-11-18T21:10:06.693ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96792024-11-18T21:10:06.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96802024-11-18T21:10:06.696ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.965916ms iteration = 19 status = null
96812024-11-18T21:10:06.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
96822024-11-18T21:10:06.743ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "96de9e6f-df83-4a49-ae69-3479d224df33", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96832024-11-18T21:10:06.743ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96842024-11-18T21:10:06.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8079a3d5-2f13-4dab-acdc-45f4159a9a6d", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96852024-11-18T21:10:06.745ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96862024-11-18T21:10:06.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d1863ba4-403d-4f55-8ee2-d502f4132c31", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96872024-11-18T21:10:06.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96882024-11-18T21:10:06.749ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
96892024-11-18T21:10:06.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 507.463925ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
96902024-11-18T21:10:06.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96912024-11-18T21:10:06.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96922024-11-18T21:10:06.762ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
96932024-11-18T21:10:06.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96942024-11-18T21:10:06.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96952024-11-18T21:10:06.771ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96962024-11-18T21:10:06.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "75853927-1886-4bff-a5f0-c9330d2e116a", "content-length": "134", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
96972024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96982024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
96992024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
97002024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
97012024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97022024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97032024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97042024-11-18T21:10:06.771ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97052024-11-18T21:10:06.772ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97062024-11-18T21:10:06.772ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97072024-11-18T21:10:06.772ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
97082024-11-18T21:10:06.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97092024-11-18T21:10:06.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97102024-11-18T21:10:06.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
97112024-11-18T21:10:06.774ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd57462-629b-4a70-915c-aa2e359abcc9", "content-length": "2", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
97122024-11-18T21:10:06.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
97132024-11-18T21:10:06.774ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ddf1c15-48e5-4ad4-a9f6-2dcddbd70121", "content-length": "51", "date": "Mon, 18 Nov 2024 21:10:05 GMT"} })
97142024-11-18T21:10:06.774ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
97152024-11-18T21:10:06.774ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
97162024-11-18T21:10:06.871ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c50cdcd8-d20d-40e3-b273-f5b37ffd48f8", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
97172024-11-18T21:10:06.871ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
97182024-11-18T21:10:06.871ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
97192024-11-18T21:10:06.871ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d42ca6ed-b073-4715-8c1c-24c8cba0ee35", "content-length": "682", "date": "Mon, 18 Nov 2024 21:10:06 GMT"} })
97202024-11-18T21:10:06.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97212024-11-18T21:10:06.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97222024-11-18T21:10:06.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97232024-11-18T21:10:06.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97242024-11-18T21:10:06.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97252024-11-18T21:10:06.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97262024-11-18T21:10:06.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97272024-11-18T21:10:06.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97282024-11-18T21:10:06.888ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 646.452811ms iteration = 19 status = {}
97292024-11-18T21:10:07.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38ed685a-1d24-4676-9186-c67711c96132 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97302024-11-18T21:10:07.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38ed685a-1d24-4676-9186-c67711c96132 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97312024-11-18T21:10:07.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38ed685a-1d24-4676-9186-c67711c96132 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97322024-11-18T21:10:08.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85602ff9-8942-4e52-9861-3d316eb688e3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97332024-11-18T21:10:08.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85602ff9-8942-4e52-9861-3d316eb688e3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97342024-11-18T21:10:08.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 85602ff9-8942-4e52-9861-3d316eb688e3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97352024-11-18T21:10:09.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 680e11d3-d198-4cda-ae7b-c82c4411224b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97362024-11-18T21:10:09.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 680e11d3-d198-4cda-ae7b-c82c4411224b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97372024-11-18T21:10:09.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 680e11d3-d198-4cda-ae7b-c82c4411224b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97382024-11-18T21:10:10.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0b1bab4f-ba67-41f0-bd75-e945c757dc43 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97392024-11-18T21:10:10.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0b1bab4f-ba67-41f0-bd75-e945c757dc43 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97402024-11-18T21:10:10.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0b1bab4f-ba67-41f0-bd75-e945c757dc43 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97412024-11-18T21:10:11.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94b6608e-ae6a-433d-8fe1-22df8464f9e4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97422024-11-18T21:10:11.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94b6608e-ae6a-433d-8fe1-22df8464f9e4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97432024-11-18T21:10:11.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 94b6608e-ae6a-433d-8fe1-22df8464f9e4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97442024-11-18T21:10:12.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed50491-dc43-4c30-8044-7a14013cb8e5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97452024-11-18T21:10:12.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed50491-dc43-4c30-8044-7a14013cb8e5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97462024-11-18T21:10:12.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ed50491-dc43-4c30-8044-7a14013cb8e5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97472024-11-18T21:10:13.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ec0e20e-0e79-4439-987c-b5ba415bdc3d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97482024-11-18T21:10:13.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ec0e20e-0e79-4439-987c-b5ba415bdc3d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97492024-11-18T21:10:13.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ec0e20e-0e79-4439-987c-b5ba415bdc3d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97502024-11-18T21:10:14.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcb38f60-4b24-4b7c-b6ca-3b834a1ccff8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97512024-11-18T21:10:14.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcb38f60-4b24-4b7c-b6ca-3b834a1ccff8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97522024-11-18T21:10:14.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dcb38f60-4b24-4b7c-b6ca-3b834a1ccff8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97532024-11-18T21:10:15.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc11ad31-3bd4-4ce6-adc8-0aca1e4d69c6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97542024-11-18T21:10:15.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc11ad31-3bd4-4ce6-adc8-0aca1e4d69c6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97552024-11-18T21:10:15.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc11ad31-3bd4-4ce6-adc8-0aca1e4d69c6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97562024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
97572024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97582024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
97592024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97602024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97612024-11-18T21:10:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97622024-11-18T21:10:16.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97632024-11-18T21:10:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642024-11-18T21:10:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97652024-11-18T21:10:16.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.633687ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97662024-11-18T21:10:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97672024-11-18T21:10:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97682024-11-18T21:10:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97692024-11-18T21:10:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97702024-11-18T21:10:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97712024-11-18T21:10:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722024-11-18T21:10:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
97732024-11-18T21:10:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97742024-11-18T21:10:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97752024-11-18T21:10:16.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
97762024-11-18T21:10:16.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.144333ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
97772024-11-18T21:10:16.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3281f65a-a968-464d-bd4a-ec42b216d625 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97782024-11-18T21:10:16.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3281f65a-a968-464d-bd4a-ec42b216d625 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97792024-11-18T21:10:16.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3281f65a-a968-464d-bd4a-ec42b216d625 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97802024-11-18T21:10:17.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10827715-26f5-4ee6-8f75-67627f4d1604 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97812024-11-18T21:10:17.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10827715-26f5-4ee6-8f75-67627f4d1604 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97822024-11-18T21:10:17.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 10827715-26f5-4ee6-8f75-67627f4d1604 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97832024-11-18T21:10:18.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978c0878-a6ef-4816-882b-c99cd5fbff50 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97842024-11-18T21:10:18.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978c0878-a6ef-4816-882b-c99cd5fbff50 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97852024-11-18T21:10:18.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 978c0878-a6ef-4816-882b-c99cd5fbff50 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97862024-11-18T21:10:19.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00a65f8c-334d-4586-8cd6-e71244b891b6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97872024-11-18T21:10:19.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00a65f8c-334d-4586-8cd6-e71244b891b6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97882024-11-18T21:10:19.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00a65f8c-334d-4586-8cd6-e71244b891b6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97892024-11-18T21:10:20.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 7ef77270-74f5-4898-9856-5ac0285eaeef response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
97902024-11-18T21:10:20.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ffec2a0-b108-4876-8276-c6b871962d6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97912024-11-18T21:10:20.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ffec2a0-b108-4876-8276-c6b871962d6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97922024-11-18T21:10:20.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4ffec2a0-b108-4876-8276-c6b871962d6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97932024-11-18T21:10:21.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ef0da98-4f8b-4b9e-a7a4-dfe132b77993 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97942024-11-18T21:10:21.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ef0da98-4f8b-4b9e-a7a4-dfe132b77993 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97952024-11-18T21:10:21.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3ef0da98-4f8b-4b9e-a7a4-dfe132b77993 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97962024-11-18T21:10:22.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4571ddcf-a3e4-4e97-b5dc-1fa31714aa3e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97972024-11-18T21:10:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4571ddcf-a3e4-4e97-b5dc-1fa31714aa3e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97982024-11-18T21:10:22.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4571ddcf-a3e4-4e97-b5dc-1fa31714aa3e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
97992024-11-18T21:10:24.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b231bf0-f065-45d9-ad29-6b08232826e5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98002024-11-18T21:10:24.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b231bf0-f065-45d9-ad29-6b08232826e5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98012024-11-18T21:10:24.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b231bf0-f065-45d9-ad29-6b08232826e5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98022024-11-18T21:10:25.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44760931-08a1-465a-adb0-51d350ef6f58 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98032024-11-18T21:10:25.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44760931-08a1-465a-adb0-51d350ef6f58 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98042024-11-18T21:10:25.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44760931-08a1-465a-adb0-51d350ef6f58 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98052024-11-18T21:10:26.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e91118ed-e64e-4a0f-8038-2172301ce549 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98062024-11-18T21:10:26.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e91118ed-e64e-4a0f-8038-2172301ce549 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98072024-11-18T21:10:26.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e91118ed-e64e-4a0f-8038-2172301ce549 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98082024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
98092024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98102024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
98112024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98122024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98132024-11-18T21:10:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98142024-11-18T21:10:26.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98152024-11-18T21:10:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98162024-11-18T21:10:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98172024-11-18T21:10:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98182024-11-18T21:10:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98192024-11-18T21:10:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98202024-11-18T21:10:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98212024-11-18T21:10:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
98222024-11-18T21:10:26.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98232024-11-18T21:10:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98242024-11-18T21:10:26.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
98252024-11-18T21:10:26.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.611996ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
98262024-11-18T21:10:26.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98272024-11-18T21:10:26.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98282024-11-18T21:10:26.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.147517ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98292024-11-18T21:10:27.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3f8125d-36e9-4ead-96b5-9d29933bdb10 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98302024-11-18T21:10:27.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3f8125d-36e9-4ead-96b5-9d29933bdb10 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98312024-11-18T21:10:27.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3f8125d-36e9-4ead-96b5-9d29933bdb10 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98322024-11-18T21:10:28.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4625741-3717-4482-9343-4a650eb156fe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98332024-11-18T21:10:28.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4625741-3717-4482-9343-4a650eb156fe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98342024-11-18T21:10:28.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a4625741-3717-4482-9343-4a650eb156fe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98352024-11-18T21:10:29.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d460089-91bd-4428-b219-2f04fbc3d59f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98362024-11-18T21:10:29.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d460089-91bd-4428-b219-2f04fbc3d59f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98372024-11-18T21:10:29.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d460089-91bd-4428-b219-2f04fbc3d59f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98382024-11-18T21:10:30.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71c7e0c-bc51-4dcb-99cc-13b61c71ac05 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98392024-11-18T21:10:30.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71c7e0c-bc51-4dcb-99cc-13b61c71ac05 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98402024-11-18T21:10:30.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d71c7e0c-bc51-4dcb-99cc-13b61c71ac05 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98412024-11-18T21:10:31.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 015b2db6-d66b-4a6d-84df-54c578f43939 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98422024-11-18T21:10:31.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 015b2db6-d66b-4a6d-84df-54c578f43939 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98432024-11-18T21:10:31.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 015b2db6-d66b-4a6d-84df-54c578f43939 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98442024-11-18T21:10:32.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 654cb9de-b126-4c88-ad56-52872e3d9d98 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98452024-11-18T21:10:32.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 654cb9de-b126-4c88-ad56-52872e3d9d98 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98462024-11-18T21:10:32.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 654cb9de-b126-4c88-ad56-52872e3d9d98 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98472024-11-18T21:10:33.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e925a4a-7238-4122-9c12-320cca935565 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98482024-11-18T21:10:33.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e925a4a-7238-4122-9c12-320cca935565 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98492024-11-18T21:10:33.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e925a4a-7238-4122-9c12-320cca935565 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98502024-11-18T21:10:34.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c8ad2e9-3e09-4cd0-b534-74a2b04a5263 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98512024-11-18T21:10:34.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c8ad2e9-3e09-4cd0-b534-74a2b04a5263 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98522024-11-18T21:10:34.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4c8ad2e9-3e09-4cd0-b534-74a2b04a5263 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98532024-11-18T21:10:35.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c98e5-69ff-4cd9-a830-5aff0d9a4f72 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98542024-11-18T21:10:35.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c98e5-69ff-4cd9-a830-5aff0d9a4f72 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98552024-11-18T21:10:35.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85c98e5-69ff-4cd9-a830-5aff0d9a4f72 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
98562024-11-18T21:10:35.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = c777beb5-910e-49ed-b838-ee48c70e27da response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
98572024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
98582024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98592024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
98602024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
98612024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
98622024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98632024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
98642024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
98652024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98662024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98672024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
98682024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98692024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
98702024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98712024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
98722024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
98732024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98742024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98752024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
98762024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
98772024-11-18T21:10:36.242ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
98782024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
98792024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98802024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
98812024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
98822024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
98832024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98842024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98852024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
98862024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
98872024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
98882024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98892024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
98902024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
98912024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98922024-11-18T21:10:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98932024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98942024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
98952024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
98962024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98972024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98982024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98992024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99002024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99012024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99022024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99032024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99042024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
99052024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99062024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99072024-11-18T21:10:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99082024-11-18T21:10:36.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 556942409 } })
99092024-11-18T21:10:36.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
99102024-11-18T21:10:36.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.213964ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
99112024-11-18T21:10:36.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 557778565 } })
99122024-11-18T21:10:36.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
99132024-11-18T21:10:36.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99142024-11-18T21:10:36.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99152024-11-18T21:10:36.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99162024-11-18T21:10:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
99172024-11-18T21:10:36.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99182024-11-18T21:10:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99192024-11-18T21:10:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99202024-11-18T21:10:36.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99212024-11-18T21:10:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99222024-11-18T21:10:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99232024-11-18T21:10:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99242024-11-18T21:10:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99252024-11-18T21:10:36.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.911914ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
99262024-11-18T21:10:36.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99272024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99282024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99292024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99302024-11-18T21:10:36.255ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99312024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
99322024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99332024-11-18T21:10:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99342024-11-18T21:10:36.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99352024-11-18T21:10:36.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99362024-11-18T21:10:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99372024-11-18T21:10:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99382024-11-18T21:10:36.256ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1545, tv_nsec: 568083832 } })
99392024-11-18T21:10:36.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
99402024-11-18T21:10:36.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99412024-11-18T21:10:36.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99422024-11-18T21:10:36.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99432024-11-18T21:10:36.258ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99442024-11-18T21:10:36.258ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
99452024-11-18T21:10:36.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99462024-11-18T21:10:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99472024-11-18T21:10:36.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99482024-11-18T21:10:36.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99492024-11-18T21:10:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99502024-11-18T21:10:36.260ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99512024-11-18T21:10:36.260ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99522024-11-18T21:10:36.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 17.44736ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99532024-11-18T21:10:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99542024-11-18T21:10:36.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99552024-11-18T21:10:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99562024-11-18T21:10:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
99572024-11-18T21:10:36.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99582024-11-18T21:10:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99592024-11-18T21:10:36.276ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99602024-11-18T21:10:36.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99612024-11-18T21:10:36.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99622024-11-18T21:10:36.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
99632024-11-18T21:10:36.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99642024-11-18T21:10:36.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99652024-11-18T21:10:36.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.616052ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
99662024-11-18T21:10:36.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99672024-11-18T21:10:36.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99682024-11-18T21:10:36.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99692024-11-18T21:10:36.288ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99702024-11-18T21:10:36.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
99712024-11-18T21:10:36.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
99722024-11-18T21:10:36.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99732024-11-18T21:10:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99742024-11-18T21:10:36.289ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99752024-11-18T21:10:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99762024-11-18T21:10:36.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00158145-050a-4ca4-8b87-2d4a26bb924d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
99772024-11-18T21:10:36.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00158145-050a-4ca4-8b87-2d4a26bb924d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
99782024-11-18T21:10:36.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
99792024-11-18T21:10:36.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
99802024-11-18T21:10:36.326ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99812024-11-18T21:10:36.326ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99822024-11-18T21:10:36.326ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d17438af-c95f-4739-abe2-36693371857c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
99832024-11-18T21:10:36.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99842024-11-18T21:10:36.326ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aa509b0-f0d1-475c-9ba3-d2790e9c3a74", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:36 GMT"} })
99852024-11-18T21:10:36.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99862024-11-18T21:10:36.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99872024-11-18T21:10:36.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99882024-11-18T21:10:36.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
99892024-11-18T21:10:36.355ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99902024-11-18T21:10:36.355ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5dd9251-be4e-45ca-aeaa-1e09f5371301", "content-length": "26", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
99912024-11-18T21:10:36.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99922024-11-18T21:10:36.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
99932024-11-18T21:10:36.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99942024-11-18T21:10:36.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99952024-11-18T21:10:36.365ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99962024-11-18T21:10:36.365ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99972024-11-18T21:10:36.365ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5977b7b-e91f-48c0-a25b-7c2ace11e0c0", "content-length": "372", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
99982024-11-18T21:10:36.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99992024-11-18T21:10:36.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100002024-11-18T21:10:36.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100012024-11-18T21:10:36.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100022024-11-18T21:10:36.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.748015ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
100032024-11-18T21:10:36.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100042024-11-18T21:10:36.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100052024-11-18T21:10:36.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00158145-050a-4ca4-8b87-2d4a26bb924d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
100062024-11-18T21:10:36.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.612927ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
100072024-11-18T21:10:36.375ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.565578ms iteration = 22 status = {"physical_disks_added":0}
100082024-11-18T21:10:36.377ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
100092024-11-18T21:10:36.377ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.906886ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
100102024-11-18T21:10:36.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 158.865825ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100112024-11-18T21:10:36.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100122024-11-18T21:10:36.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100132024-11-18T21:10:36.404ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
100142024-11-18T21:10:36.404ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 161.566076ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
100152024-11-18T21:10:36.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100162024-11-18T21:10:36.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100172024-11-18T21:10:36.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 164.627498ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100182024-11-18T21:10:36.421ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
100192024-11-18T21:10:36.422ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ded5e32-57a4-43e8-b8fc-c2ad74144133", "content-length": "1", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100202024-11-18T21:10:36.422ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100212024-11-18T21:10:36.422ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100222024-11-18T21:10:36.423ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d9c1f286-2294-49bd-9aea-6ba6ac6fc1d2", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100232024-11-18T21:10:36.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100242024-11-18T21:10:36.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100252024-11-18T21:10:36.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100262024-11-18T21:10:36.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100272024-11-18T21:10:36.424ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.089568ms iteration = 20 status = {}
100282024-11-18T21:10:36.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100292024-11-18T21:10:36.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100302024-11-18T21:10:36.425ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 183.383237ms iteration = 20 status = null
100312024-11-18T21:10:36.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100322024-11-18T21:10:36.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100332024-11-18T21:10:36.431ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100342024-11-18T21:10:36.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100352024-11-18T21:10:36.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f6117cff-10fe-4b8c-8201-924ef1a5c35a", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100362024-11-18T21:10:36.433ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 190.734183ms iteration = 20 status = {}
100372024-11-18T21:10:36.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100382024-11-18T21:10:36.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
100392024-11-18T21:10:36.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100402024-11-18T21:10:36.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100412024-11-18T21:10:36.438ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.075802ms iteration = 20 status = 0
100422024-11-18T21:10:36.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100432024-11-18T21:10:36.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100442024-11-18T21:10:36.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100452024-11-18T21:10:36.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100462024-11-18T21:10:36.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100472024-11-18T21:10:36.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100482024-11-18T21:10:36.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100492024-11-18T21:10:36.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
100502024-11-18T21:10:36.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100512024-11-18T21:10:36.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100522024-11-18T21:10:36.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100532024-11-18T21:10:36.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100542024-11-18T21:10:36.493ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
100552024-11-18T21:10:36.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100562024-11-18T21:10:36.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100572024-11-18T21:10:36.503ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100582024-11-18T21:10:36.504ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1276817-6d29-41d9-bbb7-a448cb630d43", "content-length": "134", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100592024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100602024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
100612024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100622024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100632024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100642024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100652024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100662024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100672024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100682024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100692024-11-18T21:10:36.504ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
100702024-11-18T21:10:36.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100712024-11-18T21:10:36.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100722024-11-18T21:10:36.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100732024-11-18T21:10:36.507ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "33cea729-7be2-4c31-aaa3-d52c4ddf31c7", "content-length": "2", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100742024-11-18T21:10:36.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100752024-11-18T21:10:36.507ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f8d1ba0-2d8a-4ef3-9d9a-fec3018b0047", "content-length": "51", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100762024-11-18T21:10:36.507ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
100772024-11-18T21:10:36.507ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100782024-11-18T21:10:36.570ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100792024-11-18T21:10:36.611ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f7cd15ea-457b-41e9-9ad6-fa697d6855ea", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100802024-11-18T21:10:36.611ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
100812024-11-18T21:10:36.611ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100822024-11-18T21:10:36.611ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87dfa3cd-d6e9-4746-9609-3eb5ac597567", "content-length": "691", "date": "Mon, 18 Nov 2024 21:10:35 GMT"} })
100832024-11-18T21:10:36.611ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
100842024-11-18T21:10:36.611ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
100852024-11-18T21:10:36.611ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
100862024-11-18T21:10:36.611ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0cb230-b943-4337-9752-09a424ee9049", "content-length": "682", "date": "Mon, 18 Nov 2024 21:10:36 GMT"} })
100872024-11-18T21:10:36.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100882024-11-18T21:10:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100892024-11-18T21:10:36.613ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 370.825246ms iteration = 20 status = {}
100902024-11-18T21:10:36.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100912024-11-18T21:10:36.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100922024-11-18T21:10:36.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100932024-11-18T21:10:36.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100942024-11-18T21:10:36.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100952024-11-18T21:10:36.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100962024-11-18T21:10:36.628ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 386.26293ms iteration = 20 status = {}
100972024-11-18T21:10:36.808ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
100982024-11-18T21:10:36.808ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
100992024-11-18T21:10:36.838ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
101002024-11-18T21:10:36.838ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62209
101012024-11-18T21:10:36.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62209 req_id = 7f9c115a-ad0e-488f-915d-d0c83855bb3b roles = RoleSet { roles: {} } uri = /metrics/producers
101022024-11-18T21:10:36.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62209 req_id = 7f9c115a-ad0e-488f-915d-d0c83855bb3b resource = Database result = Ok(()) uri = /metrics/producers
101032024-11-18T21:10:36.875ZINFOnexus: assigned collector to new producer collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 file = nexus/src/app/oximeter.rs:76 producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
101042024-11-18T21:10:36.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36860 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62209 req_id = 7f9c115a-ad0e-488f-915d-d0c83855bb3b response_code = 201 uri = /metrics/producers
101052024-11-18T21:10:36.875ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7f9c115a-ad0e-488f-915d-d0c83855bb3b", "content-length": "41", "date": "Mon, 18 Nov 2024 21:10:36 GMT"} })
101062024-11-18T21:10:36.876ZDEBGnexus (producer-registration-task): registered with nexus successfully
101072024-11-18T21:10:36.876ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
101082024-11-18T21:10:37.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad47dde8-151a-4d22-9741-c6345ad14576 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101092024-11-18T21:10:37.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad47dde8-151a-4d22-9741-c6345ad14576 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101102024-11-18T21:10:37.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad47dde8-151a-4d22-9741-c6345ad14576 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101112024-11-18T21:10:38.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 471b2e66-e75a-4770-a26e-6e9c2c2e60f4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101122024-11-18T21:10:38.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 471b2e66-e75a-4770-a26e-6e9c2c2e60f4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101132024-11-18T21:10:38.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 471b2e66-e75a-4770-a26e-6e9c2c2e60f4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101142024-11-18T21:10:39.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65ff8391-7e3a-4379-835c-761158f72c34 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101152024-11-18T21:10:39.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65ff8391-7e3a-4379-835c-761158f72c34 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101162024-11-18T21:10:39.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 65ff8391-7e3a-4379-835c-761158f72c34 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101172024-11-18T21:10:40.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ba640b0-1edb-4712-92bd-108759faac7a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101182024-11-18T21:10:40.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ba640b0-1edb-4712-92bd-108759faac7a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101192024-11-18T21:10:40.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ba640b0-1edb-4712-92bd-108759faac7a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101202024-11-18T21:10:41.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8706ceed-0c61-4279-b153-9777d90c4ae5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101212024-11-18T21:10:41.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8706ceed-0c61-4279-b153-9777d90c4ae5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101222024-11-18T21:10:41.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8706ceed-0c61-4279-b153-9777d90c4ae5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101232024-11-18T21:10:42.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7bd95d4-32ec-49a0-8453-5737980e4111 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101242024-11-18T21:10:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7bd95d4-32ec-49a0-8453-5737980e4111 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101252024-11-18T21:10:42.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7bd95d4-32ec-49a0-8453-5737980e4111 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101262024-11-18T21:10:43.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e47596a9-f281-4702-8ab3-09aef2c26c62 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101272024-11-18T21:10:43.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e47596a9-f281-4702-8ab3-09aef2c26c62 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101282024-11-18T21:10:43.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e47596a9-f281-4702-8ab3-09aef2c26c62 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101292024-11-18T21:10:44.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84320b7d-20c7-4176-8585-319c8792a781 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101302024-11-18T21:10:44.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84320b7d-20c7-4176-8585-319c8792a781 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101312024-11-18T21:10:44.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 84320b7d-20c7-4176-8585-319c8792a781 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101322024-11-18T21:10:45.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8cc0fecf-5df7-4fde-a6fe-2df46afa0278 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101332024-11-18T21:10:45.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8cc0fecf-5df7-4fde-a6fe-2df46afa0278 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101342024-11-18T21:10:45.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8cc0fecf-5df7-4fde-a6fe-2df46afa0278 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101352024-11-18T21:10:46.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
101362024-11-18T21:10:46.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101372024-11-18T21:10:46.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
101382024-11-18T21:10:46.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101392024-11-18T21:10:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101402024-11-18T21:10:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101412024-11-18T21:10:46.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101422024-11-18T21:10:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101432024-11-18T21:10:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101442024-11-18T21:10:46.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.903069ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101452024-11-18T21:10:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101462024-11-18T21:10:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101472024-11-18T21:10:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101482024-11-18T21:10:46.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101492024-11-18T21:10:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101502024-11-18T21:10:46.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512024-11-18T21:10:46.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
101522024-11-18T21:10:46.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101532024-11-18T21:10:46.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101542024-11-18T21:10:46.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
101552024-11-18T21:10:46.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.916252ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
101562024-11-18T21:10:46.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ccc12960-a74c-4195-9a32-2aadd6330850 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101572024-11-18T21:10:46.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ccc12960-a74c-4195-9a32-2aadd6330850 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101582024-11-18T21:10:46.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ccc12960-a74c-4195-9a32-2aadd6330850 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101592024-11-18T21:10:47.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e17855e8-48c0-48d1-b494-8fa49784f007 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101602024-11-18T21:10:47.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e17855e8-48c0-48d1-b494-8fa49784f007 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101612024-11-18T21:10:47.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e17855e8-48c0-48d1-b494-8fa49784f007 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101622024-11-18T21:10:48.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a23087b9-1bb6-4662-9851-6afebb7463d7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101632024-11-18T21:10:48.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a23087b9-1bb6-4662-9851-6afebb7463d7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101642024-11-18T21:10:48.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a23087b9-1bb6-4662-9851-6afebb7463d7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101652024-11-18T21:10:49.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 98f9f5eb-ca5b-4a3b-a05a-dd18e8645e3f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101662024-11-18T21:10:49.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 98f9f5eb-ca5b-4a3b-a05a-dd18e8645e3f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101672024-11-18T21:10:49.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 98f9f5eb-ca5b-4a3b-a05a-dd18e8645e3f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101682024-11-18T21:10:50.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e1ce23c-a245-4445-a10e-ddd44959074c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101692024-11-18T21:10:50.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e1ce23c-a245-4445-a10e-ddd44959074c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101702024-11-18T21:10:50.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e1ce23c-a245-4445-a10e-ddd44959074c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101712024-11-18T21:10:50.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 825 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 99d4c9aa-d146-4274-a619-05c1681958c3 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
101722024-11-18T21:10:51.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72e47631-7af2-4a02-9469-629315979bd8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101732024-11-18T21:10:51.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72e47631-7af2-4a02-9469-629315979bd8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101742024-11-18T21:10:51.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 72e47631-7af2-4a02-9469-629315979bd8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101752024-11-18T21:10:52.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4d22e46-f37d-4306-a04d-e22a8fe28917 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101762024-11-18T21:10:52.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4d22e46-f37d-4306-a04d-e22a8fe28917 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101772024-11-18T21:10:52.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4d22e46-f37d-4306-a04d-e22a8fe28917 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101782024-11-18T21:10:53.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b8ae378-0d48-4d28-9cb6-4d2b1397940b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101792024-11-18T21:10:53.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b8ae378-0d48-4d28-9cb6-4d2b1397940b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101802024-11-18T21:10:53.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b8ae378-0d48-4d28-9cb6-4d2b1397940b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101812024-11-18T21:10:54.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bec40b4b-3918-4016-a0af-fc91a29d8e8d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101822024-11-18T21:10:54.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bec40b4b-3918-4016-a0af-fc91a29d8e8d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101832024-11-18T21:10:54.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bec40b4b-3918-4016-a0af-fc91a29d8e8d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101842024-11-18T21:10:55.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 393a4824-d5c1-4ccc-88c0-d3804e7129dc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101852024-11-18T21:10:55.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 393a4824-d5c1-4ccc-88c0-d3804e7129dc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101862024-11-18T21:10:55.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 393a4824-d5c1-4ccc-88c0-d3804e7129dc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
101872024-11-18T21:10:56.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
101882024-11-18T21:10:56.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101892024-11-18T21:10:56.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
101902024-11-18T21:10:56.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101912024-11-18T21:10:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101922024-11-18T21:10:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101932024-11-18T21:10:56.271ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101942024-11-18T21:10:56.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101952024-11-18T21:10:56.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101962024-11-18T21:10:56.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101972024-11-18T21:10:56.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101982024-11-18T21:10:56.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101992024-11-18T21:10:56.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102002024-11-18T21:10:56.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102012024-11-18T21:10:56.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102022024-11-18T21:10:56.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
102032024-11-18T21:10:56.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102042024-11-18T21:10:56.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102052024-11-18T21:10:56.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
102062024-11-18T21:10:56.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.656853ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
102072024-11-18T21:10:56.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.832996ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102082024-11-18T21:10:56.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1f1ecf0-b35e-477f-825f-b2e3dc37bdcd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102092024-11-18T21:10:56.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1f1ecf0-b35e-477f-825f-b2e3dc37bdcd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102102024-11-18T21:10:56.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1f1ecf0-b35e-477f-825f-b2e3dc37bdcd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102112024-11-18T21:10:57.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08cab53c-45f5-4fd3-8e73-5d3412bd332e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102122024-11-18T21:10:57.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08cab53c-45f5-4fd3-8e73-5d3412bd332e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102132024-11-18T21:10:57.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08cab53c-45f5-4fd3-8e73-5d3412bd332e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102142024-11-18T21:10:58.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 331430f9-f699-40fc-b985-ca1bb22200c4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102152024-11-18T21:10:58.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 331430f9-f699-40fc-b985-ca1bb22200c4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102162024-11-18T21:10:58.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 331430f9-f699-40fc-b985-ca1bb22200c4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102172024-11-18T21:10:59.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 821723a6-c01a-4175-a862-35c799f5b2ae roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102182024-11-18T21:10:59.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 821723a6-c01a-4175-a862-35c799f5b2ae resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102192024-11-18T21:10:59.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 821723a6-c01a-4175-a862-35c799f5b2ae response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102202024-11-18T21:11:00.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30a7ebab-f49e-46cc-912e-af00d328fa1c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102212024-11-18T21:11:00.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30a7ebab-f49e-46cc-912e-af00d328fa1c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102222024-11-18T21:11:00.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30a7ebab-f49e-46cc-912e-af00d328fa1c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102232024-11-18T21:11:01.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c942189-d168-4e8f-8196-1d38e8be4626 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102242024-11-18T21:11:01.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c942189-d168-4e8f-8196-1d38e8be4626 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102252024-11-18T21:11:01.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0c942189-d168-4e8f-8196-1d38e8be4626 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102262024-11-18T21:11:02.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0b6cd71-2504-44a8-a235-edcdcac2b6ee roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102272024-11-18T21:11:02.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0b6cd71-2504-44a8-a235-edcdcac2b6ee resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102282024-11-18T21:11:02.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a0b6cd71-2504-44a8-a235-edcdcac2b6ee response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102292024-11-18T21:11:04.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ce96b04-76f4-469d-9fe7-b8b1ae4e5f99 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102302024-11-18T21:11:04.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ce96b04-76f4-469d-9fe7-b8b1ae4e5f99 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102312024-11-18T21:11:04.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1ce96b04-76f4-469d-9fe7-b8b1ae4e5f99 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102322024-11-18T21:11:05.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e61877b4-9ca1-4942-9b70-fc54e6157f99 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102332024-11-18T21:11:05.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e61877b4-9ca1-4942-9b70-fc54e6157f99 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102342024-11-18T21:11:05.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e61877b4-9ca1-4942-9b70-fc54e6157f99 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102352024-11-18T21:11:05.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 447 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 37aee367-60be-4310-9b61-d27e9edc3aef response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
102362024-11-18T21:11:06.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8369167-638c-49cb-93f3-3d0627aa63a4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102372024-11-18T21:11:06.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8369167-638c-49cb-93f3-3d0627aa63a4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102382024-11-18T21:11:06.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8369167-638c-49cb-93f3-3d0627aa63a4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
102392024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
102402024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102412024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
102422024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102432024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
102442024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
102452024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102462024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
102472024-11-18T21:11:06.242ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:01:06.242769361 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
102482024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
102492024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
102502024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
102512024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
102522024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102532024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
102542024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
102552024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
102562024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
102572024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102582024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
102592024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
102602024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102612024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102622024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
102632024-11-18T21:11:06.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
102642024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102652024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102662024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
102672024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102682024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
102692024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102702024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
102712024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102722024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
102732024-11-18T21:11:06.243ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
102742024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
102752024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102762024-11-18T21:11:06.243ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
102772024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
102782024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.44\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
102792024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
102802024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
102812024-11-18T21:11:06.243ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
102822024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
102832024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102842024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102852024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
102862024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102872024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
102882024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102892024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102902024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
102912024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
102922024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102932024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102942024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
102952024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102962024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
102972024-11-18T21:11:06.243ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
102982024-11-18T21:11:06.243ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
102992024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
103002024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103012024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
103022024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
103032024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103042024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
103052024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
103062024-11-18T21:11:06.243ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103072024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
103082024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103092024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103102024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
103112024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103122024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103132024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103142024-11-18T21:11:06.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 554571721 } })
103152024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103162024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103172024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103182024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103192024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103202024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
103212024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103222024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103232024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103242024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
103252024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103262024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103272024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103282024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103292024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103302024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
103312024-11-18T21:11:06.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 554875934 } })
103322024-11-18T21:11:06.243ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
103332024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
103342024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103352024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103362024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
103372024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103382024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
103392024-11-18T21:11:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.191809ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
103402024-11-18T21:11:06.244ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
103412024-11-18T21:11:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.38587ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
103422024-11-18T21:11:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103432024-11-18T21:11:06.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103442024-11-18T21:11:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103452024-11-18T21:11:06.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 558461940 } })
103462024-11-18T21:11:06.247ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:01:06.242769361 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
103472024-11-18T21:11:06.247ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.843456ms iteration = 11 status = {"expiration":"2024-11-18T21:01:06.242769361Z","pruned":[]}
103482024-11-18T21:11:06.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
103492024-11-18T21:11:06.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103502024-11-18T21:11:06.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 558936254 } })
103512024-11-18T21:11:06.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103522024-11-18T21:11:06.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.148628ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
103532024-11-18T21:11:06.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
103542024-11-18T21:11:06.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
103552024-11-18T21:11:06.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103562024-11-18T21:11:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103572024-11-18T21:11:06.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103582024-11-18T21:11:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103592024-11-18T21:11:06.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103602024-11-18T21:11:06.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103612024-11-18T21:11:06.264ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.128008ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
103622024-11-18T21:11:06.302ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103632024-11-18T21:11:06.303ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
103642024-11-18T21:11:06.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103652024-11-18T21:11:06.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103662024-11-18T21:11:06.305ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103672024-11-18T21:11:06.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103682024-11-18T21:11:06.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.161691ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
103692024-11-18T21:11:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103702024-11-18T21:11:06.308ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
103712024-11-18T21:11:06.308ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103722024-11-18T21:11:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103732024-11-18T21:11:06.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103742024-11-18T21:11:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103752024-11-18T21:11:06.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103762024-11-18T21:11:06.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772024-11-18T21:11:06.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103782024-11-18T21:11:06.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103792024-11-18T21:11:06.319ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103802024-11-18T21:11:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103812024-11-18T21:11:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103822024-11-18T21:11:06.320ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103832024-11-18T21:11:06.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103842024-11-18T21:11:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103852024-11-18T21:11:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
103862024-11-18T21:11:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103872024-11-18T21:11:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103882024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103892024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103902024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103912024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103922024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103932024-11-18T21:11:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103942024-11-18T21:11:06.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103952024-11-18T21:11:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
103962024-11-18T21:11:06.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103972024-11-18T21:11:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103982024-11-18T21:11:06.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.49666ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
103992024-11-18T21:11:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104002024-11-18T21:11:06.330ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104012024-11-18T21:11:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104022024-11-18T21:11:06.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104032024-11-18T21:11:06.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104042024-11-18T21:11:06.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104052024-11-18T21:11:06.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104062024-11-18T21:11:06.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104072024-11-18T21:11:06.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082024-11-18T21:11:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
104092024-11-18T21:11:06.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104102024-11-18T21:11:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104112024-11-18T21:11:06.337ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104122024-11-18T21:11:06.339ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104132024-11-18T21:11:06.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104142024-11-18T21:11:06.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104152024-11-18T21:11:06.339ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
104162024-11-18T21:11:06.339ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
104172024-11-18T21:11:06.339ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 96.754851ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
104182024-11-18T21:11:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104192024-11-18T21:11:06.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
104202024-11-18T21:11:06.341ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104212024-11-18T21:11:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104222024-11-18T21:11:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104232024-11-18T21:11:06.342ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104242024-11-18T21:11:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104252024-11-18T21:11:06.344ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
104262024-11-18T21:11:06.344ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 101.698799ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
104272024-11-18T21:11:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104282024-11-18T21:11:06.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104292024-11-18T21:11:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104302024-11-18T21:11:06.346ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 658006713 } })
104312024-11-18T21:11:06.347ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
104322024-11-18T21:11:06.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104332024-11-18T21:11:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
104342024-11-18T21:11:06.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104352024-11-18T21:11:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104362024-11-18T21:11:06.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104372024-11-18T21:11:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104382024-11-18T21:11:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104392024-11-18T21:11:06.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104402024-11-18T21:11:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104412024-11-18T21:11:06.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.787386ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104422024-11-18T21:11:06.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104432024-11-18T21:11:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104442024-11-18T21:11:06.362ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104452024-11-18T21:11:06.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104462024-11-18T21:11:06.364ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(446e44f2-6d00-4404-b1cf-f0710c40cc2b, 0), (7c6a5541-3950-4199-821b-53725769ca5b, 0), (d693199c-e47c-426b-999f-5b605a3a219e, 0)]
104472024-11-18T21:11:06.364ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1575, tv_nsec: 676046697 } })
104482024-11-18T21:11:06.365ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
104492024-11-18T21:11:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.956157ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
104502024-11-18T21:11:06.377ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
104512024-11-18T21:11:06.377ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
104522024-11-18T21:11:06.377ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
104532024-11-18T21:11:06.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104542024-11-18T21:11:06.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104552024-11-18T21:11:06.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104562024-11-18T21:11:06.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104572024-11-18T21:11:06.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104582024-11-18T21:11:06.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104592024-11-18T21:11:06.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104602024-11-18T21:11:06.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104612024-11-18T21:11:06.383ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
104622024-11-18T21:11:06.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104632024-11-18T21:11:06.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104642024-11-18T21:11:06.388ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.236304ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
104652024-11-18T21:11:06.392ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104662024-11-18T21:11:06.392ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
104672024-11-18T21:11:06.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104682024-11-18T21:11:06.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104692024-11-18T21:11:06.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104702024-11-18T21:11:06.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 151.53361ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104712024-11-18T21:11:06.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104722024-11-18T21:11:06.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104732024-11-18T21:11:06.396ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
104742024-11-18T21:11:06.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104752024-11-18T21:11:06.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104762024-11-18T21:11:06.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104772024-11-18T21:11:06.399ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
104782024-11-18T21:11:06.399ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
104792024-11-18T21:11:06.399ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 156.234946ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
104802024-11-18T21:11:06.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104812024-11-18T21:11:06.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
104822024-11-18T21:11:06.399ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104832024-11-18T21:11:06.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104842024-11-18T21:11:06.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104852024-11-18T21:11:06.403ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104862024-11-18T21:11:06.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104872024-11-18T21:11:06.407ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104882024-11-18T21:11:06.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104892024-11-18T21:11:06.407ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
104902024-11-18T21:11:06.407ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104912024-11-18T21:11:06.408ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d1ee4e9-7942-4758-8378-1834810bee44", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
104922024-11-18T21:11:06.408ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104932024-11-18T21:11:06.408ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
104942024-11-18T21:11:06.408ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
104952024-11-18T21:11:06.408ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
104962024-11-18T21:11:06.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104972024-11-18T21:11:06.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104982024-11-18T21:11:06.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
104992024-11-18T21:11:06.408ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105002024-11-18T21:11:06.409ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c4b364-839a-4e7c-a3f6-c3b2060d1935", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
105012024-11-18T21:11:06.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105022024-11-18T21:11:06.409ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105032024-11-18T21:11:06.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
105042024-11-18T21:11:06.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105052024-11-18T21:11:06.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105062024-11-18T21:11:06.410ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105072024-11-18T21:11:06.415ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105082024-11-18T21:11:06.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.714008ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105092024-11-18T21:11:06.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105102024-11-18T21:11:06.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105112024-11-18T21:11:06.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105122024-11-18T21:11:06.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105132024-11-18T21:11:06.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105142024-11-18T21:11:06.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105152024-11-18T21:11:06.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.525517ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
105162024-11-18T21:11:06.426ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
105172024-11-18T21:11:06.426ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
105182024-11-18T21:11:06.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105192024-11-18T21:11:06.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105202024-11-18T21:11:06.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105212024-11-18T21:11:06.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105222024-11-18T21:11:06.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105232024-11-18T21:11:06.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105242024-11-18T21:11:06.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105252024-11-18T21:11:06.435ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
105262024-11-18T21:11:06.435ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
105272024-11-18T21:11:06.435ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
105282024-11-18T21:11:06.435ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 192.443755ms iteration = 11 status = {"generation":1}
105292024-11-18T21:11:06.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
105302024-11-18T21:11:06.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105312024-11-18T21:11:06.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105322024-11-18T21:11:06.440ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 197.504913ms iteration = 21 status = 0
105332024-11-18T21:11:06.440ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105342024-11-18T21:11:06.440ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105352024-11-18T21:11:06.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 197.748795ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105362024-11-18T21:11:06.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105372024-11-18T21:11:06.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105382024-11-18T21:11:06.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105392024-11-18T21:11:06.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105402024-11-18T21:11:06.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105412024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
105422024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
105432024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105442024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105452024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105462024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
105472024-11-18T21:11:06.457ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 215.026034ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
105482024-11-18T21:11:06.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105492024-11-18T21:11:06.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105502024-11-18T21:11:06.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105512024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105522024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105532024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105542024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
105552024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105562024-11-18T21:11:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105572024-11-18T21:11:06.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105582024-11-18T21:11:06.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105592024-11-18T21:11:06.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105602024-11-18T21:11:06.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105612024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105622024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105632024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
105642024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
105652024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
105662024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 222.851871ms iteration = 11 status = {"generation":2}
105672024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105682024-11-18T21:11:06.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105692024-11-18T21:11:06.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105702024-11-18T21:11:06.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105712024-11-18T21:11:06.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105722024-11-18T21:11:06.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105732024-11-18T21:11:06.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105742024-11-18T21:11:06.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105752024-11-18T21:11:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105762024-11-18T21:11:06.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105772024-11-18T21:11:06.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105782024-11-18T21:11:06.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105792024-11-18T21:11:06.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105802024-11-18T21:11:06.476ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
105812024-11-18T21:11:06.476ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 232.934367ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
105822024-11-18T21:11:06.481ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.66748ms iteration = 23 status = {"physical_disks_added":0}
105832024-11-18T21:11:06.513ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
105842024-11-18T21:11:06.513ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105852024-11-18T21:11:06.513ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe88b1f1-0548-47a5-bec1-832605c26543", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
105862024-11-18T21:11:06.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105872024-11-18T21:11:06.518ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
105882024-11-18T21:11:06.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
105892024-11-18T21:11:06.580ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
105902024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
105912024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
105922024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aff4716-4f03-4db9-a4fd-4c20928b85d1", "content-length": "476", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
105932024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
105942024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6e42057-958c-4e08-9055-25d3190718bd", "content-length": "734", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
105952024-11-18T21:11:06.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
105962024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "da53a736-afdf-4e93-b7ad-e6876e3b085e", "content-length": "111", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
105972024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
105982024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "153bcc50-2abd-4a58-9bcb-da6df49cbc60", "content-length": "111", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
105992024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
106002024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dd2d81a-62c7-4564-a8f7-d4e7a4b1e546", "content-length": "167", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106012024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
106022024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e778ffb-ac07-41ba-915a-8bba2c6d8074", "content-length": "167", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106032024-11-18T21:11:06.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
106042024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b48f81-a243-4080-a11a-7a9f3bda2848", "content-length": "175", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106052024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
106062024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5d1051e-c92d-461c-8003-2ca82841a50e", "content-length": "175", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106072024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
106082024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aad8c70-4b3a-452b-891f-7a33d3f25e6c", "content-length": "702", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106092024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
106102024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c36f2577-bf3d-48a6-a411-37b18279600f", "content-length": "727", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106112024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
106122024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f52ba656-660c-4198-a3d2-c659fbc4d9b8", "content-length": "729", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106132024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
106142024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc5f785-3f04-412f-b7f6-23c9b85eda55", "content-length": "728", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
106152024-11-18T21:11:06.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
106162024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcc40867-9d5b-41be-94c6-94dbdd904a0e", "content-length": "722", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106172024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
106182024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c08d1a2e-45f4-457a-9dab-33825936fefa", "content-length": "109", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106192024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
106202024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a082973-3dca-4b21-9b57-4b7d0b6721a3", "content-length": "109", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106212024-11-18T21:11:06.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
106222024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db7140d6-ae0a-4b9a-b8da-f79f82c84ce3", "content-length": "169", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106232024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
106242024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "914e5f56-58c9-4460-ac7b-d2203f23adbb", "content-length": "169", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106252024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
106262024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "184de676-1022-41e8-ab03-b53a7bd0965b", "content-length": "178", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106272024-11-18T21:11:06.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
106282024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "54da9138-bb60-4b6e-b654-1f3badef395c", "content-length": "178", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106292024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
106302024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b165e28-021e-4f8f-a24d-1b69350e8b13", "content-length": "702", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106312024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
106322024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e39c49-bfbb-4b16-9477-adc7b8bd4135", "content-length": "727", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106332024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
106342024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a2d7ad0-3e72-4aaa-9330-f9eb87cc5263", "content-length": "729", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106352024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
106362024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c30a5d8b-3ea8-412b-be09-92d081b958bd", "content-length": "728", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106372024-11-18T21:11:06.586ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106382024-11-18T21:11:06.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106392024-11-18T21:11:06.599ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.158324ms iteration = 21 status = {}
106402024-11-18T21:11:06.601ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
106412024-11-18T21:11:06.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fea011bc-c58e-4e57-be9b-6f3e948612a5", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
106422024-11-18T21:11:06.601ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
106432024-11-18T21:11:06.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b5d49b01-010c-4d8c-8075-6be289e50d5a", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
106442024-11-18T21:11:06.602ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
106452024-11-18T21:11:06.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
106462024-11-18T21:11:06.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 361.564247ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
106472024-11-18T21:11:06.654ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106482024-11-18T21:11:06.654ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece2bb76-f522-4027-a364-a45baed1dd04", "content-length": "1", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106492024-11-18T21:11:06.656ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106502024-11-18T21:11:06.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106512024-11-18T21:11:06.660ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106522024-11-18T21:11:06.660ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106532024-11-18T21:11:06.660ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "584772b6-ce13-4cac-95bf-b561ebef156e", "content-length": "372", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
106542024-11-18T21:11:06.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106552024-11-18T21:11:06.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106562024-11-18T21:11:06.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106572024-11-18T21:11:06.662ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106582024-11-18T21:11:06.662ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 420.109133ms iteration = 21 status = null
106592024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
106602024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106612024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106622024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106632024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106642024-11-18T21:11:06.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106652024-11-18T21:11:06.666ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106662024-11-18T21:11:06.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106672024-11-18T21:11:06.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106682024-11-18T21:11:06.669ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106692024-11-18T21:11:06.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106702024-11-18T21:11:06.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
106712024-11-18T21:11:06.669ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106722024-11-18T21:11:06.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106732024-11-18T21:11:06.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106742024-11-18T21:11:06.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106752024-11-18T21:11:06.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106762024-11-18T21:11:06.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106772024-11-18T21:11:06.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106782024-11-18T21:11:06.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106792024-11-18T21:11:06.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106802024-11-18T21:11:06.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106812024-11-18T21:11:06.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106822024-11-18T21:11:06.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
106832024-11-18T21:11:06.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106842024-11-18T21:11:06.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106852024-11-18T21:11:06.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106862024-11-18T21:11:06.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106872024-11-18T21:11:06.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106882024-11-18T21:11:06.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106892024-11-18T21:11:06.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106902024-11-18T21:11:06.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
106912024-11-18T21:11:06.689ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106922024-11-18T21:11:06.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106932024-11-18T21:11:06.694ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106942024-11-18T21:11:06.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106952024-11-18T21:11:06.696ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106962024-11-18T21:11:06.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106972024-11-18T21:11:06.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106982024-11-18T21:11:06.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106992024-11-18T21:11:06.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107002024-11-18T21:11:06.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107012024-11-18T21:11:06.702ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107022024-11-18T21:11:06.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107032024-11-18T21:11:06.702ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107042024-11-18T21:11:06.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107052024-11-18T21:11:06.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0a6200ea-12d0-4f96-be35-8ca1e66f9eb3", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
107062024-11-18T21:11:06.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107072024-11-18T21:11:06.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107082024-11-18T21:11:06.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107092024-11-18T21:11:06.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107102024-11-18T21:11:06.704ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dc6cc5f5-5958-468c-93b4-fb8a3dc9f36d", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107112024-11-18T21:11:06.704ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107122024-11-18T21:11:06.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107132024-11-18T21:11:06.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107142024-11-18T21:11:06.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107152024-11-18T21:11:06.705ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3974d71d-c1ec-419c-bb03-e51c857653ae", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107162024-11-18T21:11:06.705ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107172024-11-18T21:11:06.705ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107182024-11-18T21:11:06.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107192024-11-18T21:11:06.707ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0e388379-866a-4c62-8f45-c56f950867f4", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107202024-11-18T21:11:06.707ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107212024-11-18T21:11:06.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107222024-11-18T21:11:06.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107232024-11-18T21:11:06.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107242024-11-18T21:11:06.708ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107252024-11-18T21:11:06.709ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
107262024-11-18T21:11:06.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 466.475419ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
107272024-11-18T21:11:06.710ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dd804e9-df05-42b6-b4da-32697b872fbd", "content-length": "691", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
107282024-11-18T21:11:06.710ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107292024-11-18T21:11:06.710ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107302024-11-18T21:11:06.710ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107312024-11-18T21:11:06.710ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107322024-11-18T21:11:06.710ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107332024-11-18T21:11:06.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
107342024-11-18T21:11:06.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107352024-11-18T21:11:06.711ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "55313518-365c-452b-9424-ea95c065e092", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
107362024-11-18T21:11:06.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107372024-11-18T21:11:06.711ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 468.801596ms iteration = 21 status = {}
107382024-11-18T21:11:06.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107392024-11-18T21:11:06.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107402024-11-18T21:11:06.713ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 470.280767ms iteration = 21 status = {}
107412024-11-18T21:11:06.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107422024-11-18T21:11:06.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107432024-11-18T21:11:06.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107442024-11-18T21:11:06.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
107452024-11-18T21:11:06.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107462024-11-18T21:11:06.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107472024-11-18T21:11:06.725ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
107482024-11-18T21:11:06.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107492024-11-18T21:11:06.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107502024-11-18T21:11:06.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107512024-11-18T21:11:06.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
107522024-11-18T21:11:06.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107532024-11-18T21:11:06.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107542024-11-18T21:11:06.789ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
107552024-11-18T21:11:06.789ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
107562024-11-18T21:11:06.790ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
107572024-11-18T21:11:06.790ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3b3dea8a-e84f-4acf-bafc-3b0e4a815dc5, kind: Service { id: be35e232-dd9b-4d59-b4e1-eadb7f69bb77 }, name: Name("external-dns-be35e232-dd9b-4d59-b4e1-eadb7f69bb77"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95dce781-7d6b-4bf1-88f1-880b60d0adba, kind: Service { id: 14e637a2-51ce-4cac-b831-85b757e5c55d }, name: Name("external-dns-14e637a2-51ce-4cac-b831-85b757e5c55d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5dbd0a76-35d9-4b29-8800-824968d1caba, kind: Service { id: 9b2d2174-b236-4546-bace-300e05afe3c2 }, name: Name("nexus-9b2d2174-b236-4546-bace-300e05afe3c2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: db0c0ea5-0d8f-4f9d-9979-f3989ce962ea, kind: Service { id: 16a7178a-dbb6-4392-b395-7bddb3817d13 }, name: Name("nexus-16a7178a-dbb6-4392-b395-7bddb3817d13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 19])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e67bea26-1a67-4166-875f-3cab431644e6, kind: Service { id: 3dce42ed-74cb-4c8b-9326-8273a1efd563 }, name: Name("nexus-3dce42ed-74cb-4c8b-9326-8273a1efd563"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
107582024-11-18T21:11:06.791ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
107592024-11-18T21:11:06.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107602024-11-18T21:11:06.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107612024-11-18T21:11:06.798ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
107622024-11-18T21:11:06.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107632024-11-18T21:11:06.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107642024-11-18T21:11:06.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107652024-11-18T21:11:06.809ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5714fa0-0a70-4811-9d3a-a4f067183264", "content-length": "134", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
107662024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107672024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
107682024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107692024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107702024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107712024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107722024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107732024-11-18T21:11:06.809ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107742024-11-18T21:11:06.810ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107752024-11-18T21:11:06.810ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107762024-11-18T21:11:06.813ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
107772024-11-18T21:11:06.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107782024-11-18T21:11:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107792024-11-18T21:11:06.815ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107802024-11-18T21:11:06.815ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2695353-113b-4887-8f54-aa2f60a27277", "content-length": "2", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
107812024-11-18T21:11:06.815ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107822024-11-18T21:11:06.815ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2a1287-80c3-4811-bb2b-90b0ed2790e7", "content-length": "51", "date": "Mon, 18 Nov 2024 21:11:05 GMT"} })
107832024-11-18T21:11:06.815ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
107842024-11-18T21:11:06.815ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107852024-11-18T21:11:06.907ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 79cbda5a-2e27-489e-945d-860d86dec819, time_created: 2024-11-18T21:01:57.213298Z, time_modified: 2024-11-18T21:01:57.213298Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
107862024-11-18T21:11:06.907ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
107872024-11-18T21:11:06.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107882024-11-18T21:11:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107892024-11-18T21:11:06.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107902024-11-18T21:11:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107912024-11-18T21:11:06.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107922024-11-18T21:11:06.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
107932024-11-18T21:11:06.944ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
107942024-11-18T21:11:06.948ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "fa4c90f7-a6a7-4b02-8e04-ebc76ee267c8", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
107952024-11-18T21:11:06.949ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
107962024-11-18T21:11:06.949ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 706.227517ms
107972024-11-18T21:11:06.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 706.238797ms iteration = 3 status = {}
107982024-11-18T21:11:06.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "df6ab9f0-b505-4d83-b428-397bc36b2bdb", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
107992024-11-18T21:11:06.952ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
108002024-11-18T21:11:06.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108012024-11-18T21:11:06.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab9b241-ef6a-4046-adb5-6625f0e7b267", "content-length": "682", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
108022024-11-18T21:11:06.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108032024-11-18T21:11:06.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108042024-11-18T21:11:06.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108052024-11-18T21:11:06.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108062024-11-18T21:11:06.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108072024-11-18T21:11:06.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108082024-11-18T21:11:06.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108092024-11-18T21:11:06.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108102024-11-18T21:11:06.973ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.379757ms iteration = 21 status = {}
108112024-11-18T21:11:07.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f65ad83-df3a-42dd-8a31-515dc4465a2f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108122024-11-18T21:11:07.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f65ad83-df3a-42dd-8a31-515dc4465a2f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108132024-11-18T21:11:07.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f65ad83-df3a-42dd-8a31-515dc4465a2f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108142024-11-18T21:11:07.136ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a4b28fa-6b08-4ce8-b067-a63590149c4b", "content-length": "30754", "date": "Mon, 18 Nov 2024 21:11:06 GMT"} })
108152024-11-18T21:11:07.138ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
108162024-11-18T21:11:07.138ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
108172024-11-18T21:11:07.138ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
108182024-11-18T21:11:07.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108192024-11-18T21:11:07.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108202024-11-18T21:11:07.141ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108212024-11-18T21:11:07.143ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
108222024-11-18T21:11:07.143ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108232024-11-18T21:11:07.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108242024-11-18T21:11:07.295ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 674459c0-7df9-4a12-83c8-30e40ba5f1f0 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
108252024-11-18T21:11:07.295ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 674459c0-7df9-4a12-83c8-30e40ba5f1f0 time_started = 2024-11-18 21:11:06.580969 UTC
108262024-11-18T21:11:07.295ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.052347428s iteration = 3 status = {"collection_id":"674459c0-7df9-4a12-83c8-30e40ba5f1f0","time_done":"2024-11-18 21:11:07.138248 UTC","time_started":"2024-11-18 21:11:06.580969 UTC"}
108272024-11-18T21:11:07.295ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
108282024-11-18T21:11:07.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108292024-11-18T21:11:07.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108302024-11-18T21:11:07.297ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108312024-11-18T21:11:07.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108322024-11-18T21:11:07.299ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108332024-11-18T21:11:07.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108342024-11-18T21:11:07.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108352024-11-18T21:11:07.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108362024-11-18T21:11:07.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108372024-11-18T21:11:07.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108382024-11-18T21:11:07.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108392024-11-18T21:11:07.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108402024-11-18T21:11:07.342ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.496597ms iteration = 24 status = {"physical_disks_added":0}
108412024-11-18T21:11:08.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8fdec0-b9e4-4bd5-8750-53fa65826f70 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108422024-11-18T21:11:08.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8fdec0-b9e4-4bd5-8750-53fa65826f70 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108432024-11-18T21:11:08.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8fdec0-b9e4-4bd5-8750-53fa65826f70 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108442024-11-18T21:11:09.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75f1a567-4572-462e-ba1a-4778ee158bfd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108452024-11-18T21:11:09.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75f1a567-4572-462e-ba1a-4778ee158bfd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108462024-11-18T21:11:09.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75f1a567-4572-462e-ba1a-4778ee158bfd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108472024-11-18T21:11:10.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3e125f9f-77b5-481b-a545-26738c477458 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108482024-11-18T21:11:10.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3e125f9f-77b5-481b-a545-26738c477458 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108492024-11-18T21:11:10.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3e125f9f-77b5-481b-a545-26738c477458 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108502024-11-18T21:11:11.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a4e3549-490b-4c12-ae87-06afb0f5bf5d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108512024-11-18T21:11:11.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a4e3549-490b-4c12-ae87-06afb0f5bf5d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108522024-11-18T21:11:11.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9a4e3549-490b-4c12-ae87-06afb0f5bf5d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108532024-11-18T21:11:12.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9ccfbbf-720e-48ba-85be-1e26c2ab4ff1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108542024-11-18T21:11:12.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9ccfbbf-720e-48ba-85be-1e26c2ab4ff1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108552024-11-18T21:11:12.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9ccfbbf-720e-48ba-85be-1e26c2ab4ff1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108562024-11-18T21:11:13.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9eaf1c7-251d-42c9-adf7-6774ab05f621 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108572024-11-18T21:11:13.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9eaf1c7-251d-42c9-adf7-6774ab05f621 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108582024-11-18T21:11:13.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9eaf1c7-251d-42c9-adf7-6774ab05f621 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108592024-11-18T21:11:14.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dbbec9c0-58da-4909-919c-08e539eb8884 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108602024-11-18T21:11:14.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dbbec9c0-58da-4909-919c-08e539eb8884 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108612024-11-18T21:11:14.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dbbec9c0-58da-4909-919c-08e539eb8884 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108622024-11-18T21:11:15.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9f3e50a-ef2a-4767-867b-bbdac034669b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108632024-11-18T21:11:15.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9f3e50a-ef2a-4767-867b-bbdac034669b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108642024-11-18T21:11:15.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9f3e50a-ef2a-4767-867b-bbdac034669b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108652024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
108662024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108672024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
108682024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108692024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108702024-11-18T21:11:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108712024-11-18T21:11:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108722024-11-18T21:11:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108732024-11-18T21:11:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108742024-11-18T21:11:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108752024-11-18T21:11:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108762024-11-18T21:11:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108772024-11-18T21:11:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108782024-11-18T21:11:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
108792024-11-18T21:11:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108802024-11-18T21:11:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108812024-11-18T21:11:16.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
108822024-11-18T21:11:16.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.275569ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
108832024-11-18T21:11:16.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108842024-11-18T21:11:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108852024-11-18T21:11:16.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.394688ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108862024-11-18T21:11:16.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad28ac5-01e6-451c-ab05-36bd2e16a09b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108872024-11-18T21:11:16.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad28ac5-01e6-451c-ab05-36bd2e16a09b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108882024-11-18T21:11:16.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ad28ac5-01e6-451c-ab05-36bd2e16a09b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108892024-11-18T21:11:17.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53a69745-2bf0-479a-a4e1-4e805d111f70 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108902024-11-18T21:11:17.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53a69745-2bf0-479a-a4e1-4e805d111f70 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108912024-11-18T21:11:17.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 53a69745-2bf0-479a-a4e1-4e805d111f70 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108922024-11-18T21:11:18.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e094852b-5085-4a84-a02b-efc9bf2077a4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108932024-11-18T21:11:18.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e094852b-5085-4a84-a02b-efc9bf2077a4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108942024-11-18T21:11:18.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e094852b-5085-4a84-a02b-efc9bf2077a4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108952024-11-18T21:11:19.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fdc0fe35-97c7-4ec7-b6a2-353a325b714d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108962024-11-18T21:11:19.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fdc0fe35-97c7-4ec7-b6a2-353a325b714d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108972024-11-18T21:11:19.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fdc0fe35-97c7-4ec7-b6a2-353a325b714d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108982024-11-18T21:11:20.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdb3203-3569-4ff7-99e9-6dc98e6f3a89 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
108992024-11-18T21:11:20.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdb3203-3569-4ff7-99e9-6dc98e6f3a89 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109002024-11-18T21:11:20.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = efdb3203-3569-4ff7-99e9-6dc98e6f3a89 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109012024-11-18T21:11:20.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = a5d6e96b-9eb3-4c75-9118-61a2228a9612 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
109022024-11-18T21:11:21.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97ecdc23-0213-463a-83d3-730e159716d8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109032024-11-18T21:11:21.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97ecdc23-0213-463a-83d3-730e159716d8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109042024-11-18T21:11:21.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97ecdc23-0213-463a-83d3-730e159716d8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109052024-11-18T21:11:22.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69791c88-98e7-4f11-9dee-787e4ba95516 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109062024-11-18T21:11:22.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69791c88-98e7-4f11-9dee-787e4ba95516 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109072024-11-18T21:11:22.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69791c88-98e7-4f11-9dee-787e4ba95516 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109082024-11-18T21:11:23.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef15c59-fedd-482b-bd01-d529c5483063 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109092024-11-18T21:11:23.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef15c59-fedd-482b-bd01-d529c5483063 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109102024-11-18T21:11:23.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ef15c59-fedd-482b-bd01-d529c5483063 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109112024-11-18T21:11:24.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71dbacbc-5e91-4833-afe0-9dbc353053f0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109122024-11-18T21:11:24.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71dbacbc-5e91-4833-afe0-9dbc353053f0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109132024-11-18T21:11:24.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 71dbacbc-5e91-4833-afe0-9dbc353053f0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109142024-11-18T21:11:25.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a534600c-9f14-4f9c-8e4d-c575942e46a6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109152024-11-18T21:11:25.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a534600c-9f14-4f9c-8e4d-c575942e46a6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109162024-11-18T21:11:25.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a534600c-9f14-4f9c-8e4d-c575942e46a6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109172024-11-18T21:11:26.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
109182024-11-18T21:11:26.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
109192024-11-18T21:11:26.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109202024-11-18T21:11:26.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109212024-11-18T21:11:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109222024-11-18T21:11:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109232024-11-18T21:11:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109242024-11-18T21:11:26.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109252024-11-18T21:11:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109262024-11-18T21:11:26.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.889959ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109272024-11-18T21:11:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109282024-11-18T21:11:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109292024-11-18T21:11:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109302024-11-18T21:11:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109312024-11-18T21:11:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109322024-11-18T21:11:26.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109332024-11-18T21:11:26.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
109342024-11-18T21:11:26.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109352024-11-18T21:11:26.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109362024-11-18T21:11:26.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
109372024-11-18T21:11:26.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.500198ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
109382024-11-18T21:11:26.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0535640-fadd-49ef-bc8a-ef3fdeef705a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109392024-11-18T21:11:26.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0535640-fadd-49ef-bc8a-ef3fdeef705a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109402024-11-18T21:11:26.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0535640-fadd-49ef-bc8a-ef3fdeef705a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109412024-11-18T21:11:27.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be868348-a7fa-40b8-98cf-ceca688e3872 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109422024-11-18T21:11:27.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be868348-a7fa-40b8-98cf-ceca688e3872 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109432024-11-18T21:11:27.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be868348-a7fa-40b8-98cf-ceca688e3872 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109442024-11-18T21:11:28.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 93478292-3654-447e-8915-f38f1eee7438 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109452024-11-18T21:11:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 93478292-3654-447e-8915-f38f1eee7438 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109462024-11-18T21:11:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 93478292-3654-447e-8915-f38f1eee7438 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109472024-11-18T21:11:29.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c710e40d-6bca-42f0-8fdf-6e2ba92f492b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109482024-11-18T21:11:29.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c710e40d-6bca-42f0-8fdf-6e2ba92f492b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109492024-11-18T21:11:29.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c710e40d-6bca-42f0-8fdf-6e2ba92f492b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109502024-11-18T21:11:30.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 807742d7-b985-4453-bb28-dd1055cab033 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109512024-11-18T21:11:30.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 807742d7-b985-4453-bb28-dd1055cab033 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109522024-11-18T21:11:30.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 807742d7-b985-4453-bb28-dd1055cab033 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109532024-11-18T21:11:31.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ca40afd-9dfb-4728-b897-1ea62d0426c9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109542024-11-18T21:11:31.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ca40afd-9dfb-4728-b897-1ea62d0426c9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109552024-11-18T21:11:31.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ca40afd-9dfb-4728-b897-1ea62d0426c9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109562024-11-18T21:11:32.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3b09b07-36ea-4354-b935-23d7cff82aaf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109572024-11-18T21:11:32.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3b09b07-36ea-4354-b935-23d7cff82aaf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109582024-11-18T21:11:32.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d3b09b07-36ea-4354-b935-23d7cff82aaf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109592024-11-18T21:11:33.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75413980-e1e4-466f-836f-deaec0386c69 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109602024-11-18T21:11:33.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75413980-e1e4-466f-836f-deaec0386c69 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109612024-11-18T21:11:33.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 75413980-e1e4-466f-836f-deaec0386c69 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109622024-11-18T21:11:34.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f9e8329-ebeb-4128-afe3-2a77a1f4e2b3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109632024-11-18T21:11:34.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f9e8329-ebeb-4128-afe3-2a77a1f4e2b3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109642024-11-18T21:11:34.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f9e8329-ebeb-4128-afe3-2a77a1f4e2b3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109652024-11-18T21:11:35.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88d5bc02-9387-47d1-99c9-f4b2813d2fce roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109662024-11-18T21:11:35.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88d5bc02-9387-47d1-99c9-f4b2813d2fce resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109672024-11-18T21:11:35.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88d5bc02-9387-47d1-99c9-f4b2813d2fce response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
109682024-11-18T21:11:35.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 6643c71d-e928-47ca-ba7d-4f3a267acfb0 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
109692024-11-18T21:11:36.242ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
109702024-11-18T21:11:36.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
109712024-11-18T21:11:36.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109722024-11-18T21:11:36.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109732024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
109742024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109752024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
109762024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
109772024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109782024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
109792024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109802024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109812024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
109822024-11-18T21:11:36.243ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109832024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
109842024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109852024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109862024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
109872024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
109882024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109892024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
109902024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109912024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
109922024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
109932024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109942024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109952024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109962024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
109972024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109982024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
109992024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110002024-11-18T21:11:36.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
110012024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110022024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
110032024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110042024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
110052024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110062024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110072024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110082024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110092024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110102024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110112024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110122024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110132024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110142024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110152024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110162024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110172024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110182024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110192024-11-18T21:11:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110202024-11-18T21:11:36.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 556247364 } })
110212024-11-18T21:11:36.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
110222024-11-18T21:11:36.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 556936049 } })
110232024-11-18T21:11:36.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
110242024-11-18T21:11:36.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110252024-11-18T21:11:36.247ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110262024-11-18T21:11:36.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110272024-11-18T21:11:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.337442ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110282024-11-18T21:11:36.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110292024-11-18T21:11:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110302024-11-18T21:11:36.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110312024-11-18T21:11:36.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110322024-11-18T21:11:36.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110332024-11-18T21:11:36.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110342024-11-18T21:11:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110352024-11-18T21:11:36.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110362024-11-18T21:11:36.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110372024-11-18T21:11:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110382024-11-18T21:11:36.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110392024-11-18T21:11:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110402024-11-18T21:11:36.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110412024-11-18T21:11:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110422024-11-18T21:11:36.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110432024-11-18T21:11:36.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110442024-11-18T21:11:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110452024-11-18T21:11:36.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110462024-11-18T21:11:36.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110472024-11-18T21:11:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110482024-11-18T21:11:36.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110492024-11-18T21:11:36.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110502024-11-18T21:11:36.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1605, tv_nsec: 570535620 } })
110512024-11-18T21:11:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110522024-11-18T21:11:36.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110532024-11-18T21:11:36.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
110542024-11-18T21:11:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110552024-11-18T21:11:36.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110562024-11-18T21:11:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110572024-11-18T21:11:36.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110582024-11-18T21:11:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110592024-11-18T21:11:36.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110602024-11-18T21:11:36.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110612024-11-18T21:11:36.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110622024-11-18T21:11:36.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110632024-11-18T21:11:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
110642024-11-18T21:11:36.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110652024-11-18T21:11:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110662024-11-18T21:11:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110672024-11-18T21:11:36.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110682024-11-18T21:11:36.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110692024-11-18T21:11:36.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.626751ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
110702024-11-18T21:11:36.286ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110712024-11-18T21:11:36.286ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110722024-11-18T21:11:36.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110732024-11-18T21:11:36.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110742024-11-18T21:11:36.286ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110752024-11-18T21:11:36.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110762024-11-18T21:11:36.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
110772024-11-18T21:11:36.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.646105ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
110782024-11-18T21:11:36.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110792024-11-18T21:11:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110802024-11-18T21:11:36.294ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110812024-11-18T21:11:36.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.728629ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
110822024-11-18T21:11:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110832024-11-18T21:11:36.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110842024-11-18T21:11:36.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110852024-11-18T21:11:36.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110862024-11-18T21:11:36.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110872024-11-18T21:11:36.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.60293ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
110882024-11-18T21:11:36.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110892024-11-18T21:11:36.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110902024-11-18T21:11:36.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110912024-11-18T21:11:36.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110922024-11-18T21:11:36.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110932024-11-18T21:11:36.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
110942024-11-18T21:11:36.307ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110952024-11-18T21:11:36.307ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "870df312-c94f-439c-81dc-79e3afcef02b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:35 GMT"} })
110962024-11-18T21:11:36.307ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110972024-11-18T21:11:36.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
110982024-11-18T21:11:36.307ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110992024-11-18T21:11:36.308ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5f0e639-b113-4b4d-929a-3c327a8531cd", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:35 GMT"} })
111002024-11-18T21:11:36.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111012024-11-18T21:11:36.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
111022024-11-18T21:11:36.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111032024-11-18T21:11:36.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111042024-11-18T21:11:36.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111052024-11-18T21:11:36.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111062024-11-18T21:11:36.313ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.775601ms iteration = 22 status = 0
111072024-11-18T21:11:36.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.279894ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111082024-11-18T21:11:36.318ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111092024-11-18T21:11:36.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.385635ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111102024-11-18T21:11:36.330ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.588536ms iteration = 25 status = {"physical_disks_added":0}
111112024-11-18T21:11:36.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
111122024-11-18T21:11:36.331ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111132024-11-18T21:11:36.331ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc1d706-dcd1-488b-9961-e2984bd815b7", "content-length": "26", "date": "Mon, 18 Nov 2024 21:11:35 GMT"} })
111142024-11-18T21:11:36.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111152024-11-18T21:11:36.331ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111162024-11-18T21:11:36.331ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111172024-11-18T21:11:36.331ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111182024-11-18T21:11:36.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.265088ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111192024-11-18T21:11:36.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111202024-11-18T21:11:36.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
111212024-11-18T21:11:36.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.41321ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111222024-11-18T21:11:36.361ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111232024-11-18T21:11:36.361ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111242024-11-18T21:11:36.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.903969ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111252024-11-18T21:11:36.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111262024-11-18T21:11:36.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111272024-11-18T21:11:36.397ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.183437ms iteration = 22 status = {}
111282024-11-18T21:11:36.443ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
111292024-11-18T21:11:36.444ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "602c84e6-1f88-4d31-8547-93fab55372c8", "content-length": "1", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111302024-11-18T21:11:36.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111312024-11-18T21:11:36.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111322024-11-18T21:11:36.481ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111332024-11-18T21:11:36.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111342024-11-18T21:11:36.484ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.291179ms iteration = 22 status = null
111352024-11-18T21:11:36.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111362024-11-18T21:11:36.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111372024-11-18T21:11:36.527ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
111382024-11-18T21:11:36.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111392024-11-18T21:11:36.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111402024-11-18T21:11:36.536ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111412024-11-18T21:11:36.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "30cf259b-5087-4829-afab-9be830d61a7a", "content-length": "134", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111422024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111432024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
111442024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111452024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111462024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111472024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111482024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111492024-11-18T21:11:36.536ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111502024-11-18T21:11:36.537ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111512024-11-18T21:11:36.537ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111522024-11-18T21:11:36.537ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
111532024-11-18T21:11:36.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111542024-11-18T21:11:36.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111552024-11-18T21:11:36.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
111562024-11-18T21:11:36.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfaf8929-6966-40b9-a261-a8ede2faad45", "content-length": "2", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111572024-11-18T21:11:36.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
111582024-11-18T21:11:36.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "12c43eeb-c518-42b1-8cb7-e6edb661c5a1", "content-length": "51", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111592024-11-18T21:11:36.539ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
111602024-11-18T21:11:36.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111612024-11-18T21:11:36.543ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c72a7a8-0c1a-47a1-8e15-b47cb3d642ac", "content-length": "372", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111622024-11-18T21:11:36.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111632024-11-18T21:11:36.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111642024-11-18T21:11:36.562ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
111652024-11-18T21:11:36.562ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111662024-11-18T21:11:36.564ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d5345d93-4c94-4e53-b5b9-faf6960142f8", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111672024-11-18T21:11:36.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111682024-11-18T21:11:36.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111692024-11-18T21:11:36.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111702024-11-18T21:11:36.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111712024-11-18T21:11:36.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111722024-11-18T21:11:36.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111732024-11-18T21:11:36.573ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
111742024-11-18T21:11:36.573ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111752024-11-18T21:11:36.576ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "976c9490-e7c1-48bb-acc3-469e6fc84c07", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111762024-11-18T21:11:36.578ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.438744ms iteration = 22 status = {}
111772024-11-18T21:11:36.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111782024-11-18T21:11:36.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111792024-11-18T21:11:36.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111802024-11-18T21:11:36.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111812024-11-18T21:11:36.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111822024-11-18T21:11:36.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111832024-11-18T21:11:36.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111842024-11-18T21:11:36.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111852024-11-18T21:11:36.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111862024-11-18T21:11:36.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111872024-11-18T21:11:36.623ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111882024-11-18T21:11:36.623ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "28593601-f400-41b8-a271-e73c24d461a7", "content-length": "691", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111892024-11-18T21:11:36.624ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
111902024-11-18T21:11:36.624ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
111912024-11-18T21:11:36.624ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
111922024-11-18T21:11:36.625ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.647777ms iteration = 22 status = {}
111932024-11-18T21:11:36.640ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8192d34e-d051-4606-820c-d4f5f83cc5c2", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111942024-11-18T21:11:36.640ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
111952024-11-18T21:11:36.640ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
111962024-11-18T21:11:36.640ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce598d12-3a3a-41aa-a628-ac78e925cead", "content-length": "682", "date": "Mon, 18 Nov 2024 21:11:36 GMT"} })
111972024-11-18T21:11:36.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111982024-11-18T21:11:36.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111992024-11-18T21:11:36.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112002024-11-18T21:11:36.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112012024-11-18T21:11:36.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112022024-11-18T21:11:36.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112032024-11-18T21:11:36.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112042024-11-18T21:11:36.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112052024-11-18T21:11:36.655ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 411.968193ms iteration = 22 status = {}
112062024-11-18T21:11:36.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76e120d9-04f1-4a34-92b7-6e8460a5df52 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112072024-11-18T21:11:36.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76e120d9-04f1-4a34-92b7-6e8460a5df52 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112082024-11-18T21:11:36.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 76e120d9-04f1-4a34-92b7-6e8460a5df52 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112092024-11-18T21:11:37.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9892c005-7941-4b21-a1e0-a4a7e48b221d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112102024-11-18T21:11:37.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9892c005-7941-4b21-a1e0-a4a7e48b221d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112112024-11-18T21:11:37.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9892c005-7941-4b21-a1e0-a4a7e48b221d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112122024-11-18T21:11:38.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 163823dc-a2f3-4a0a-b194-ed5811478be1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112132024-11-18T21:11:38.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 163823dc-a2f3-4a0a-b194-ed5811478be1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112142024-11-18T21:11:38.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 163823dc-a2f3-4a0a-b194-ed5811478be1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112152024-11-18T21:11:39.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e35fac0-b8e9-47c0-a35e-14ecf279363c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112162024-11-18T21:11:39.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e35fac0-b8e9-47c0-a35e-14ecf279363c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112172024-11-18T21:11:39.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e35fac0-b8e9-47c0-a35e-14ecf279363c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112182024-11-18T21:11:40.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9fdb276e-cf5f-48a9-800f-28fe858f8776 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112192024-11-18T21:11:40.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9fdb276e-cf5f-48a9-800f-28fe858f8776 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112202024-11-18T21:11:40.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9fdb276e-cf5f-48a9-800f-28fe858f8776 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112212024-11-18T21:11:41.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3ba9f16-9c96-4b3b-a642-996b0c4071a4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112222024-11-18T21:11:41.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3ba9f16-9c96-4b3b-a642-996b0c4071a4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112232024-11-18T21:11:41.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3ba9f16-9c96-4b3b-a642-996b0c4071a4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112242024-11-18T21:11:42.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f5b34d5-05c4-41e1-85f8-733cba00c60a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112252024-11-18T21:11:42.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f5b34d5-05c4-41e1-85f8-733cba00c60a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112262024-11-18T21:11:42.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7f5b34d5-05c4-41e1-85f8-733cba00c60a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112272024-11-18T21:11:43.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e36b267-fea8-4d8a-b5ac-71c08571acb1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112282024-11-18T21:11:43.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e36b267-fea8-4d8a-b5ac-71c08571acb1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112292024-11-18T21:11:43.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9e36b267-fea8-4d8a-b5ac-71c08571acb1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112302024-11-18T21:11:44.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b6eef36-f7aa-4ad3-93dd-37145938bdaf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112312024-11-18T21:11:44.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b6eef36-f7aa-4ad3-93dd-37145938bdaf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112322024-11-18T21:11:44.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6b6eef36-f7aa-4ad3-93dd-37145938bdaf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112332024-11-18T21:11:46.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5a91ea0-7726-46c5-aec6-2f520f02a3ce roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112342024-11-18T21:11:46.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5a91ea0-7726-46c5-aec6-2f520f02a3ce resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112352024-11-18T21:11:46.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e5a91ea0-7726-46c5-aec6-2f520f02a3ce response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112362024-11-18T21:11:46.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
112372024-11-18T21:11:46.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
112382024-11-18T21:11:46.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112392024-11-18T21:11:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112402024-11-18T21:11:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112412024-11-18T21:11:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112422024-11-18T21:11:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112432024-11-18T21:11:46.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112442024-11-18T21:11:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112452024-11-18T21:11:46.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.799896ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112462024-11-18T21:11:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112472024-11-18T21:11:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112482024-11-18T21:11:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112492024-11-18T21:11:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112502024-11-18T21:11:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112512024-11-18T21:11:46.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112522024-11-18T21:11:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
112532024-11-18T21:11:46.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112542024-11-18T21:11:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112552024-11-18T21:11:46.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
112562024-11-18T21:11:46.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.79816ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
112572024-11-18T21:11:47.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22acd32f-aed5-4534-ad4b-a8968cca5d54 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112582024-11-18T21:11:47.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22acd32f-aed5-4534-ad4b-a8968cca5d54 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112592024-11-18T21:11:47.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22acd32f-aed5-4534-ad4b-a8968cca5d54 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112602024-11-18T21:11:48.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb9bdd3a-78bc-4f96-9527-6a117e6ae24c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112612024-11-18T21:11:48.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb9bdd3a-78bc-4f96-9527-6a117e6ae24c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112622024-11-18T21:11:48.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = eb9bdd3a-78bc-4f96-9527-6a117e6ae24c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112632024-11-18T21:11:49.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 797c2bf3-20a3-4a2c-85bc-1001c6c519ab roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112642024-11-18T21:11:49.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 797c2bf3-20a3-4a2c-85bc-1001c6c519ab resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112652024-11-18T21:11:49.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 797c2bf3-20a3-4a2c-85bc-1001c6c519ab response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112662024-11-18T21:11:50.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0eb14cb-9d07-44ec-97db-f2572b658cd5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112672024-11-18T21:11:50.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0eb14cb-9d07-44ec-97db-f2572b658cd5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112682024-11-18T21:11:50.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f0eb14cb-9d07-44ec-97db-f2572b658cd5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112692024-11-18T21:11:50.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 5d3aec6d-e028-4d96-b4ff-b8a7037635e1 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
112702024-11-18T21:11:51.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c124638f-0705-497d-ace8-afedc1b92e91 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112712024-11-18T21:11:51.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c124638f-0705-497d-ace8-afedc1b92e91 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112722024-11-18T21:11:51.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c124638f-0705-497d-ace8-afedc1b92e91 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112732024-11-18T21:11:52.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ac733214-942c-4295-bdf8-cb4faa578ba5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112742024-11-18T21:11:52.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ac733214-942c-4295-bdf8-cb4faa578ba5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112752024-11-18T21:11:52.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ac733214-942c-4295-bdf8-cb4faa578ba5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112762024-11-18T21:11:53.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb4e5af9-45a2-4c82-96ee-5e441c780303 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112772024-11-18T21:11:53.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb4e5af9-45a2-4c82-96ee-5e441c780303 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112782024-11-18T21:11:53.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb4e5af9-45a2-4c82-96ee-5e441c780303 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112792024-11-18T21:11:54.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1bd635e5-163f-4cf0-a19a-1cd240d5f29f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112802024-11-18T21:11:54.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1bd635e5-163f-4cf0-a19a-1cd240d5f29f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112812024-11-18T21:11:54.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1bd635e5-163f-4cf0-a19a-1cd240d5f29f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112822024-11-18T21:11:55.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d682b52-f9e4-4ae5-9d21-d1ea0a054445 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112832024-11-18T21:11:55.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d682b52-f9e4-4ae5-9d21-d1ea0a054445 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112842024-11-18T21:11:55.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d682b52-f9e4-4ae5-9d21-d1ea0a054445 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
112852024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
112862024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
112872024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112882024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112892024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112902024-11-18T21:11:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112912024-11-18T21:11:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112922024-11-18T21:11:56.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112932024-11-18T21:11:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112942024-11-18T21:11:56.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.759898ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112952024-11-18T21:11:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112962024-11-18T21:11:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112972024-11-18T21:11:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112982024-11-18T21:11:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112992024-11-18T21:11:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113002024-11-18T21:11:56.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113012024-11-18T21:11:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
113022024-11-18T21:11:56.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113032024-11-18T21:11:56.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113042024-11-18T21:11:56.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e08544f-ffe4-48ed-bdb6-95a852aff37c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113052024-11-18T21:11:56.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e08544f-ffe4-48ed-bdb6-95a852aff37c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113062024-11-18T21:11:56.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6e08544f-ffe4-48ed-bdb6-95a852aff37c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113072024-11-18T21:11:56.272ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
113082024-11-18T21:11:56.272ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.528623ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
113092024-11-18T21:11:57.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e55ee4b-b810-44cf-bf52-2e2ef7767953 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113102024-11-18T21:11:57.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e55ee4b-b810-44cf-bf52-2e2ef7767953 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113112024-11-18T21:11:57.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e55ee4b-b810-44cf-bf52-2e2ef7767953 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113122024-11-18T21:11:58.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5479671-f070-4818-a124-9c229940499d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113132024-11-18T21:11:58.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5479671-f070-4818-a124-9c229940499d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113142024-11-18T21:11:58.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d5479671-f070-4818-a124-9c229940499d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113152024-11-18T21:11:59.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad0ed613-c1c0-4831-89a4-11782b6c0dc2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113162024-11-18T21:11:59.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad0ed613-c1c0-4831-89a4-11782b6c0dc2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113172024-11-18T21:11:59.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ad0ed613-c1c0-4831-89a4-11782b6c0dc2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113182024-11-18T21:12:00.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 100f8e14-4374-41a5-ac1f-e6c4b9c81ec7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113192024-11-18T21:12:00.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 100f8e14-4374-41a5-ac1f-e6c4b9c81ec7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113202024-11-18T21:12:00.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 100f8e14-4374-41a5-ac1f-e6c4b9c81ec7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113212024-11-18T21:12:01.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61ea0c03-37bb-447d-b63f-9c21ace3c784 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113222024-11-18T21:12:01.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61ea0c03-37bb-447d-b63f-9c21ace3c784 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113232024-11-18T21:12:01.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61ea0c03-37bb-447d-b63f-9c21ace3c784 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113242024-11-18T21:12:02.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 827949ed-d70a-48f8-aaff-b8bfc8de095a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113252024-11-18T21:12:02.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 827949ed-d70a-48f8-aaff-b8bfc8de095a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113262024-11-18T21:12:02.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 827949ed-d70a-48f8-aaff-b8bfc8de095a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113272024-11-18T21:12:03.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96d5e46d-11ee-44f3-9088-f7673537a307 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113282024-11-18T21:12:03.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96d5e46d-11ee-44f3-9088-f7673537a307 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113292024-11-18T21:12:03.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96d5e46d-11ee-44f3-9088-f7673537a307 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113302024-11-18T21:12:04.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c5050fe1-d3a3-49df-a4f8-dd002fa3cbf2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113312024-11-18T21:12:04.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c5050fe1-d3a3-49df-a4f8-dd002fa3cbf2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113322024-11-18T21:12:04.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c5050fe1-d3a3-49df-a4f8-dd002fa3cbf2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113332024-11-18T21:12:05.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 411099fb-5393-40ef-b4c6-cf3ad07b025f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113342024-11-18T21:12:05.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 411099fb-5393-40ef-b4c6-cf3ad07b025f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113352024-11-18T21:12:05.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 411099fb-5393-40ef-b4c6-cf3ad07b025f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
113362024-11-18T21:12:05.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 4385ba92-1f5e-4c37-a913-3303cf6f8699 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
113372024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
113382024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
113392024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113402024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113412024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
113422024-11-18T21:12:06.242ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
113432024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
113442024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
113452024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113462024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
113472024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
113482024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113492024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
113502024-11-18T21:12:06.243ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:02:06.243007007 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
113512024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
113522024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
113532024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
113542024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113552024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
113562024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113572024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113582024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
113592024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113602024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113612024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113622024-11-18T21:12:06.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 553998477 } })
113632024-11-18T21:12:06.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 554014827 } })
113642024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
113652024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113662024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
113672024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
113682024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113692024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113702024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113712024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
113722024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
113732024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
113742024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
113752024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113762024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113772024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
113782024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113792024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
113802024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
113812024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
113822024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113832024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
113842024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
113852024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113862024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113872024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
113882024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
113892024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
113902024-11-18T21:12:06.243ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113912024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113922024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
113932024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113942024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
113952024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
113962024-11-18T21:12:06.243ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
113972024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
113982024-11-18T21:12:06.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.32\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
113992024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114002024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
114012024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
114022024-11-18T21:12:06.244ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
114032024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
114042024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114052024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114062024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
114072024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114082024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114092024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
114102024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114112024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114122024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114132024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114142024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114152024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114162024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
114172024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
114182024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114192024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
114202024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.441361ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
114212024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114222024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114232024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
114242024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
114252024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114262024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.381ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
114272024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114282024-11-18T21:12:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114292024-11-18T21:12:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114302024-11-18T21:12:06.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114312024-11-18T21:12:06.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 556153443 } })
114322024-11-18T21:12:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114332024-11-18T21:12:06.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
114342024-11-18T21:12:06.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114352024-11-18T21:12:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114362024-11-18T21:12:06.246ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:02:06.243007007 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
114372024-11-18T21:12:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.738947ms iteration = 12 status = {"expiration":"2024-11-18T21:02:06.243007007Z","pruned":[]}
114382024-11-18T21:12:06.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
114392024-11-18T21:12:06.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114402024-11-18T21:12:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114412024-11-18T21:12:06.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 558437000 } })
114422024-11-18T21:12:06.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
114432024-11-18T21:12:06.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114442024-11-18T21:12:06.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114452024-11-18T21:12:06.250ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.937372ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114462024-11-18T21:12:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114472024-11-18T21:12:06.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114482024-11-18T21:12:06.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114492024-11-18T21:12:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114502024-11-18T21:12:06.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114512024-11-18T21:12:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114522024-11-18T21:12:06.257ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.998495ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
114532024-11-18T21:12:06.257ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
114542024-11-18T21:12:06.257ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
114552024-11-18T21:12:06.257ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.144045ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
114562024-11-18T21:12:06.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114572024-11-18T21:12:06.258ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114582024-11-18T21:12:06.258ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114592024-11-18T21:12:06.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114602024-11-18T21:12:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114612024-11-18T21:12:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114622024-11-18T21:12:06.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114632024-11-18T21:12:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114642024-11-18T21:12:06.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114652024-11-18T21:12:06.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114662024-11-18T21:12:06.264ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114672024-11-18T21:12:06.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114682024-11-18T21:12:06.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114692024-11-18T21:12:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114702024-11-18T21:12:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
114712024-11-18T21:12:06.267ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114722024-11-18T21:12:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
114732024-11-18T21:12:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
114742024-11-18T21:12:06.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114752024-11-18T21:12:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114762024-11-18T21:12:06.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114772024-11-18T21:12:06.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114782024-11-18T21:12:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114792024-11-18T21:12:06.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114802024-11-18T21:12:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114812024-11-18T21:12:06.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114822024-11-18T21:12:06.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114832024-11-18T21:12:06.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114842024-11-18T21:12:06.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114852024-11-18T21:12:06.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114862024-11-18T21:12:06.280ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
114872024-11-18T21:12:06.280ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
114882024-11-18T21:12:06.280ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
114892024-11-18T21:12:06.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114902024-11-18T21:12:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114912024-11-18T21:12:06.281ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1635, tv_nsec: 592002870 } })
114922024-11-18T21:12:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114932024-11-18T21:12:06.281ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
114942024-11-18T21:12:06.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114952024-11-18T21:12:06.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114962024-11-18T21:12:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114972024-11-18T21:12:06.283ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
114982024-11-18T21:12:06.283ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
114992024-11-18T21:12:06.283ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
115002024-11-18T21:12:06.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115012024-11-18T21:12:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115022024-11-18T21:12:06.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115032024-11-18T21:12:06.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115042024-11-18T21:12:06.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115052024-11-18T21:12:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115062024-11-18T21:12:06.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115072024-11-18T21:12:06.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
115082024-11-18T21:12:06.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115092024-11-18T21:12:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115102024-11-18T21:12:06.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
115112024-11-18T21:12:06.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115122024-11-18T21:12:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115132024-11-18T21:12:06.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115142024-11-18T21:12:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115152024-11-18T21:12:06.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115162024-11-18T21:12:06.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115172024-11-18T21:12:06.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115182024-11-18T21:12:06.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115192024-11-18T21:12:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
115202024-11-18T21:12:06.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115212024-11-18T21:12:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115222024-11-18T21:12:06.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115232024-11-18T21:12:06.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
115242024-11-18T21:12:06.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115252024-11-18T21:12:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115262024-11-18T21:12:06.300ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115272024-11-18T21:12:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115282024-11-18T21:12:06.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115292024-11-18T21:12:06.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115302024-11-18T21:12:06.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
115312024-11-18T21:12:06.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.050835ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
115322024-11-18T21:12:06.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.090416ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115332024-11-18T21:12:06.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.744521ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
115342024-11-18T21:12:06.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115352024-11-18T21:12:06.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115362024-11-18T21:12:06.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115372024-11-18T21:12:06.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115382024-11-18T21:12:06.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115392024-11-18T21:12:06.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.598922ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115402024-11-18T21:12:06.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.786151ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
115412024-11-18T21:12:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115422024-11-18T21:12:06.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115432024-11-18T21:12:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115442024-11-18T21:12:06.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115452024-11-18T21:12:06.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115462024-11-18T21:12:06.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115472024-11-18T21:12:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115482024-11-18T21:12:06.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.355635ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
115492024-11-18T21:12:06.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115502024-11-18T21:12:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115512024-11-18T21:12:06.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115522024-11-18T21:12:06.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115532024-11-18T21:12:06.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115542024-11-18T21:12:06.321ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115552024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115562024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115572024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115582024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115592024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
115602024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115612024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115622024-11-18T21:12:06.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115632024-11-18T21:12:06.322ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
115642024-11-18T21:12:06.322ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
115652024-11-18T21:12:06.322ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.446325ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
115662024-11-18T21:12:06.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115672024-11-18T21:12:06.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115682024-11-18T21:12:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
115692024-11-18T21:12:06.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115702024-11-18T21:12:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115712024-11-18T21:12:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115722024-11-18T21:12:06.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115732024-11-18T21:12:06.330ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
115742024-11-18T21:12:06.330ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
115752024-11-18T21:12:06.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115762024-11-18T21:12:06.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115772024-11-18T21:12:06.331ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.505203ms iteration = 23 status = 0
115782024-11-18T21:12:06.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115792024-11-18T21:12:06.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115802024-11-18T21:12:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115812024-11-18T21:12:06.336ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115822024-11-18T21:12:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115832024-11-18T21:12:06.336ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
115842024-11-18T21:12:06.336ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
115852024-11-18T21:12:06.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115862024-11-18T21:12:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115872024-11-18T21:12:06.338ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115882024-11-18T21:12:06.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115892024-11-18T21:12:06.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115902024-11-18T21:12:06.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.101944ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
115912024-11-18T21:12:06.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
115922024-11-18T21:12:06.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115932024-11-18T21:12:06.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115942024-11-18T21:12:06.345ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
115952024-11-18T21:12:06.345ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 102.819416ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
115962024-11-18T21:12:06.347ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
115972024-11-18T21:12:06.347ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
115982024-11-18T21:12:06.347ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
115992024-11-18T21:12:06.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.507809ms iteration = 12 status = {"generation":2}
116002024-11-18T21:12:06.359ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116012024-11-18T21:12:06.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.31029ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116022024-11-18T21:12:06.371ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116032024-11-18T21:12:06.371ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116042024-11-18T21:12:06.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.239626ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116052024-11-18T21:12:06.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116062024-11-18T21:12:06.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
116072024-11-18T21:12:06.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116082024-11-18T21:12:06.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116092024-11-18T21:12:06.381ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
116102024-11-18T21:12:06.381ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
116112024-11-18T21:12:06.381ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
116122024-11-18T21:12:06.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.20147ms iteration = 12 status = {"generation":1}
116132024-11-18T21:12:06.383ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
116142024-11-18T21:12:06.383ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 139.48093ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
116152024-11-18T21:12:06.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
116162024-11-18T21:12:06.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
116172024-11-18T21:12:06.404ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116182024-11-18T21:12:06.404ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e658e7-dbe8-477b-a008-308b39f42ef8", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
116192024-11-18T21:12:06.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116202024-11-18T21:12:06.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116212024-11-18T21:12:06.411ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.781591ms iteration = 26 status = {"physical_disks_added":0}
116222024-11-18T21:12:06.415ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
116232024-11-18T21:12:06.415ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116242024-11-18T21:12:06.415ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cece53d8-e82d-45c7-bd9d-4261cfe90442", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
116252024-11-18T21:12:06.415ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116262024-11-18T21:12:06.416ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116272024-11-18T21:12:06.477ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
116282024-11-18T21:12:06.477ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116292024-11-18T21:12:06.477ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffbd00b6-f503-417a-a48a-d6b2b9fe3ac1", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
116302024-11-18T21:12:06.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116312024-11-18T21:12:06.479ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
116322024-11-18T21:12:06.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f836106c-abba-41e1-82e6-5a9550651dbc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
116332024-11-18T21:12:06.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f836106c-abba-41e1-82e6-5a9550651dbc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
116342024-11-18T21:12:06.503ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
116352024-11-18T21:12:06.571ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
116362024-11-18T21:12:06.571ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b6af2ae-a467-4a36-b0a3-54d4828de6de", "content-length": "691", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
116372024-11-18T21:12:06.571ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
116382024-11-18T21:12:06.571ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
116392024-11-18T21:12:06.571ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
116402024-11-18T21:12:06.572ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 328.797262ms iteration = 23 status = {}
116412024-11-18T21:12:06.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f836106c-abba-41e1-82e6-5a9550651dbc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
116422024-11-18T21:12:06.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
116432024-11-18T21:12:06.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1b109b44-8a78-48c0-8e5a-f78363a96dd3", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
116442024-11-18T21:12:06.579ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
116452024-11-18T21:12:06.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e94e34c6-8eda-4245-9476-984882504d05", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
116462024-11-18T21:12:06.581ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
116472024-11-18T21:12:06.582ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
116482024-11-18T21:12:06.582ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 339.452192ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
116492024-11-18T21:12:06.623ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116502024-11-18T21:12:06.623ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116512024-11-18T21:12:06.624ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116522024-11-18T21:12:06.624ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "44d7d6db-d69d-425c-be91-29a56501c7b2", "content-length": "1", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
116532024-11-18T21:12:06.625ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116542024-11-18T21:12:06.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116552024-11-18T21:12:06.627ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 384.981872ms iteration = 23 status = null
116562024-11-18T21:12:06.633ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 390.377121ms iteration = 23 status = {}
116572024-11-18T21:12:06.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
116582024-11-18T21:12:06.698ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a45ce921-3e2c-4444-9ee3-1aa98486c4c4", "content-length": "372", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
116592024-11-18T21:12:06.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116602024-11-18T21:12:06.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116612024-11-18T21:12:06.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
116622024-11-18T21:12:06.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116632024-11-18T21:12:06.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0b17ac3-0281-4562-baa6-1b576aae393b", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
116642024-11-18T21:12:06.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116652024-11-18T21:12:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116662024-11-18T21:12:06.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116672024-11-18T21:12:06.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116682024-11-18T21:12:06.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116692024-11-18T21:12:06.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116702024-11-18T21:12:06.721ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116712024-11-18T21:12:06.721ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116722024-11-18T21:12:06.721ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4969e141-720c-44fd-87bb-537ea453c683", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
116732024-11-18T21:12:06.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
116742024-11-18T21:12:06.723ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 480.10241ms iteration = 23 status = {}
116752024-11-18T21:12:06.724ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c2cbc5e1-875b-4561-9cd8-52553612502e", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116762024-11-18T21:12:06.724ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116772024-11-18T21:12:06.726ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "11fee427-03f6-426c-ac5c-906996d7541f", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116782024-11-18T21:12:06.726ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116792024-11-18T21:12:06.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e0c2a4c3-5200-467f-8c83-43bfdd473bfc", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116802024-11-18T21:12:06.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116812024-11-18T21:12:06.730ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
116822024-11-18T21:12:06.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.057223ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
116832024-11-18T21:12:06.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116842024-11-18T21:12:06.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116852024-11-18T21:12:06.739ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
116862024-11-18T21:12:06.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116872024-11-18T21:12:06.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116882024-11-18T21:12:06.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
116892024-11-18T21:12:06.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "22c466f6-08b1-4153-a452-1eb3f2d09d63", "content-length": "134", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
116902024-11-18T21:12:06.746ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116912024-11-18T21:12:06.746ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
116922024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116932024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116942024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116952024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116962024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116972024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116982024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116992024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117002024-11-18T21:12:06.747ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
117012024-11-18T21:12:06.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117022024-11-18T21:12:06.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117032024-11-18T21:12:06.748ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
117042024-11-18T21:12:06.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e61d8064-26ed-4641-b22d-cc809ba107e5", "content-length": "2", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
117052024-11-18T21:12:06.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
117062024-11-18T21:12:06.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ec8d37-870c-4d61-b9d0-1adf25396c85", "content-length": "51", "date": "Mon, 18 Nov 2024 21:12:05 GMT"} })
117072024-11-18T21:12:06.749ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
117082024-11-18T21:12:06.749ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
117092024-11-18T21:12:06.844ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "53dce4ea-b65d-45a3-b5d3-d44df178e8d4", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
117102024-11-18T21:12:06.844ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
117112024-11-18T21:12:06.844ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117122024-11-18T21:12:06.844ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd20bb2-b05b-48b1-a80b-2a15d56ab5b5", "content-length": "682", "date": "Mon, 18 Nov 2024 21:12:06 GMT"} })
117132024-11-18T21:12:06.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117142024-11-18T21:12:06.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117152024-11-18T21:12:06.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117162024-11-18T21:12:06.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117172024-11-18T21:12:06.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117182024-11-18T21:12:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117192024-11-18T21:12:06.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117202024-11-18T21:12:06.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117212024-11-18T21:12:06.861ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.405445ms iteration = 23 status = {}
117222024-11-18T21:12:07.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 305e0b1b-536e-47c8-8c3a-5ef28c3d5d53 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117232024-11-18T21:12:07.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 305e0b1b-536e-47c8-8c3a-5ef28c3d5d53 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117242024-11-18T21:12:07.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 305e0b1b-536e-47c8-8c3a-5ef28c3d5d53 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117252024-11-18T21:12:08.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb9ecc2e-b51a-48b5-b31d-f5bfc8f8c734 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117262024-11-18T21:12:08.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb9ecc2e-b51a-48b5-b31d-f5bfc8f8c734 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117272024-11-18T21:12:08.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb9ecc2e-b51a-48b5-b31d-f5bfc8f8c734 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117282024-11-18T21:12:09.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a96e522-45f5-44cf-a743-dc37ff664c20 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117292024-11-18T21:12:09.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a96e522-45f5-44cf-a743-dc37ff664c20 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117302024-11-18T21:12:09.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0a96e522-45f5-44cf-a743-dc37ff664c20 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117312024-11-18T21:12:10.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 371d20ee-6622-4c80-891b-2039314dd718 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117322024-11-18T21:12:10.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 371d20ee-6622-4c80-891b-2039314dd718 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117332024-11-18T21:12:10.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 371d20ee-6622-4c80-891b-2039314dd718 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117342024-11-18T21:12:10.870ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48240
117352024-11-18T21:12:10.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 0700a4a1-08d8-4c34-87fc-9fe2ec4580e2 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
117362024-11-18T21:12:10.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 0700a4a1-08d8-4c34-87fc-9fe2ec4580e2 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
117372024-11-18T21:12:10.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 0700a4a1-08d8-4c34-87fc-9fe2ec4580e2 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
117382024-11-18T21:12:10.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 365632c9-ba5e-47c8-ae11-976fddec4e63 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
117392024-11-18T21:12:10.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 365632c9-ba5e-47c8-ae11-976fddec4e63 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
117402024-11-18T21:12:10.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 365632c9-ba5e-47c8-ae11-976fddec4e63 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
117412024-11-18T21:12:11.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2336f776-6dbd-473b-92ce-228b1982c55c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117422024-11-18T21:12:11.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2336f776-6dbd-473b-92ce-228b1982c55c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117432024-11-18T21:12:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2336f776-6dbd-473b-92ce-228b1982c55c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117442024-11-18T21:12:12.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 406cef2a-09e4-4a26-9733-0971902ced5e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117452024-11-18T21:12:12.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 406cef2a-09e4-4a26-9733-0971902ced5e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117462024-11-18T21:12:12.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 406cef2a-09e4-4a26-9733-0971902ced5e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117472024-11-18T21:12:13.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1a0ac988-ebcc-46d8-a3fa-7b5262fa1bd9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117482024-11-18T21:12:13.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1a0ac988-ebcc-46d8-a3fa-7b5262fa1bd9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117492024-11-18T21:12:13.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1a0ac988-ebcc-46d8-a3fa-7b5262fa1bd9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117502024-11-18T21:12:14.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dfa4f31-451f-46da-8680-8bccd99cc762 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117512024-11-18T21:12:14.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dfa4f31-451f-46da-8680-8bccd99cc762 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117522024-11-18T21:12:14.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dfa4f31-451f-46da-8680-8bccd99cc762 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117532024-11-18T21:12:15.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82401b24-229e-47b0-9d1e-82168c321fb6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117542024-11-18T21:12:15.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82401b24-229e-47b0-9d1e-82168c321fb6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117552024-11-18T21:12:15.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 82401b24-229e-47b0-9d1e-82168c321fb6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117562024-11-18T21:12:16.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
117572024-11-18T21:12:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117582024-11-18T21:12:16.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
117592024-11-18T21:12:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117602024-11-18T21:12:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117612024-11-18T21:12:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117622024-11-18T21:12:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117632024-11-18T21:12:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117642024-11-18T21:12:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117652024-11-18T21:12:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117662024-11-18T21:12:16.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117672024-11-18T21:12:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117682024-11-18T21:12:16.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117692024-11-18T21:12:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
117702024-11-18T21:12:16.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117712024-11-18T21:12:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117722024-11-18T21:12:16.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
117732024-11-18T21:12:16.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.239763ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
117742024-11-18T21:12:16.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117752024-11-18T21:12:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117762024-11-18T21:12:16.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.636324ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117772024-11-18T21:12:16.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b2967463-4bff-4228-ae81-0bf65854596b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117782024-11-18T21:12:16.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b2967463-4bff-4228-ae81-0bf65854596b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117792024-11-18T21:12:16.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b2967463-4bff-4228-ae81-0bf65854596b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117802024-11-18T21:12:17.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3b59408e-f5d3-46ad-b308-c426f908855b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117812024-11-18T21:12:17.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3b59408e-f5d3-46ad-b308-c426f908855b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117822024-11-18T21:12:17.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3b59408e-f5d3-46ad-b308-c426f908855b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117832024-11-18T21:12:18.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dcda632-5570-463d-acd7-b0e0f6333ea6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117842024-11-18T21:12:18.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dcda632-5570-463d-acd7-b0e0f6333ea6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117852024-11-18T21:12:18.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4dcda632-5570-463d-acd7-b0e0f6333ea6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117862024-11-18T21:12:19.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1e8c9918-d98d-408b-a654-315ac4170d03 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117872024-11-18T21:12:19.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1e8c9918-d98d-408b-a654-315ac4170d03 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117882024-11-18T21:12:19.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1e8c9918-d98d-408b-a654-315ac4170d03 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117892024-11-18T21:12:20.877ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 5c85fac0-f4de-4d01-a316-964ef0905ea0 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
117902024-11-18T21:12:20.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85ac5c5-b0f9-4f2e-94c8-2cc3dc77c7c7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117912024-11-18T21:12:20.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85ac5c5-b0f9-4f2e-94c8-2cc3dc77c7c7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117922024-11-18T21:12:20.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c85ac5c5-b0f9-4f2e-94c8-2cc3dc77c7c7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117932024-11-18T21:12:21.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8108eeae-f4ae-4d4b-944b-a33d78935765 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117942024-11-18T21:12:21.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8108eeae-f4ae-4d4b-944b-a33d78935765 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117952024-11-18T21:12:21.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8108eeae-f4ae-4d4b-944b-a33d78935765 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117962024-11-18T21:12:22.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 217f6186-6574-45ef-baa9-fc48141ed5cb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117972024-11-18T21:12:22.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 217f6186-6574-45ef-baa9-fc48141ed5cb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117982024-11-18T21:12:22.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 217f6186-6574-45ef-baa9-fc48141ed5cb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
117992024-11-18T21:12:23.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed45c7d9-db9a-47cd-8bc3-03254eda45d6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118002024-11-18T21:12:23.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed45c7d9-db9a-47cd-8bc3-03254eda45d6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118012024-11-18T21:12:23.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed45c7d9-db9a-47cd-8bc3-03254eda45d6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118022024-11-18T21:12:25.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f06d3c20-7554-448e-ab82-d0bb8d975a24 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118032024-11-18T21:12:25.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f06d3c20-7554-448e-ab82-d0bb8d975a24 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118042024-11-18T21:12:25.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f06d3c20-7554-448e-ab82-d0bb8d975a24 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118052024-11-18T21:12:26.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13a58d-33e6-49bf-9509-d5891fc3e8fb roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118062024-11-18T21:12:26.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13a58d-33e6-49bf-9509-d5891fc3e8fb resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118072024-11-18T21:12:26.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bc13a58d-33e6-49bf-9509-d5891fc3e8fb response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118082024-11-18T21:12:26.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
118092024-11-18T21:12:26.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
118102024-11-18T21:12:26.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118112024-11-18T21:12:26.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118122024-11-18T21:12:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118132024-11-18T21:12:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118142024-11-18T21:12:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118152024-11-18T21:12:26.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118162024-11-18T21:12:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118172024-11-18T21:12:26.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.640122ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118182024-11-18T21:12:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118192024-11-18T21:12:26.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118202024-11-18T21:12:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118212024-11-18T21:12:26.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118222024-11-18T21:12:26.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118232024-11-18T21:12:26.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118242024-11-18T21:12:26.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
118252024-11-18T21:12:26.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118262024-11-18T21:12:26.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118272024-11-18T21:12:26.272ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
118282024-11-18T21:12:26.272ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.631386ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
118292024-11-18T21:12:27.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 341d913b-8660-421e-b477-ffd78fbf53ea roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118302024-11-18T21:12:27.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 341d913b-8660-421e-b477-ffd78fbf53ea resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118312024-11-18T21:12:27.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 341d913b-8660-421e-b477-ffd78fbf53ea response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118322024-11-18T21:12:28.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b834712d-5bc9-4ab6-b722-c8cca42b1778 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118332024-11-18T21:12:28.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b834712d-5bc9-4ab6-b722-c8cca42b1778 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118342024-11-18T21:12:28.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b834712d-5bc9-4ab6-b722-c8cca42b1778 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118352024-11-18T21:12:29.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52b863c6-5fcb-4891-9c84-18c74f7a275a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118362024-11-18T21:12:29.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52b863c6-5fcb-4891-9c84-18c74f7a275a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118372024-11-18T21:12:29.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52b863c6-5fcb-4891-9c84-18c74f7a275a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118382024-11-18T21:12:30.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a134019-2696-4e7f-a00a-3b8b56483605 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118392024-11-18T21:12:30.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a134019-2696-4e7f-a00a-3b8b56483605 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118402024-11-18T21:12:30.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a134019-2696-4e7f-a00a-3b8b56483605 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118412024-11-18T21:12:31.056ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35742605-d142-414f-bcae-515e605b29c7 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-18T21:12:31.036039672Z }
118422024-11-18T21:12:31.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35742605-d142-414f-bcae-515e605b29c7 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118432024-11-18T21:12:31.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35742605-d142-414f-bcae-515e605b29c7 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118442024-11-18T21:12:31.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72091 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 35742605-d142-414f-bcae-515e605b29c7 response_code = 204 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118452024-11-18T21:12:31.109ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00ecce14-9d65-4732-9aef-97bd21814f08 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-18T21:12:31.109256498Z }
118462024-11-18T21:12:31.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00ecce14-9d65-4732-9aef-97bd21814f08 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118472024-11-18T21:12:31.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00ecce14-9d65-4732-9aef-97bd21814f08 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118482024-11-18T21:12:31.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37412 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 00ecce14-9d65-4732-9aef-97bd21814f08 response_code = 204 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
118492024-11-18T21:12:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16082bdb-5c69-42cc-baca-6613d65e5753 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118502024-11-18T21:12:31.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16082bdb-5c69-42cc-baca-6613d65e5753 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118512024-11-18T21:12:31.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 16082bdb-5c69-42cc-baca-6613d65e5753 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118522024-11-18T21:12:32.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fd288b-1ef9-49a6-b1ed-1881bec2fc20 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118532024-11-18T21:12:32.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fd288b-1ef9-49a6-b1ed-1881bec2fc20 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118542024-11-18T21:12:32.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fd288b-1ef9-49a6-b1ed-1881bec2fc20 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118552024-11-18T21:12:33.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 204ac7a5-5f8c-44cc-b2df-2bc7e9464cea roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118562024-11-18T21:12:33.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 204ac7a5-5f8c-44cc-b2df-2bc7e9464cea resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118572024-11-18T21:12:33.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 204ac7a5-5f8c-44cc-b2df-2bc7e9464cea response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118582024-11-18T21:12:34.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f6cd7c3-24ec-4b39-8070-8341f0b2cf23 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118592024-11-18T21:12:34.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f6cd7c3-24ec-4b39-8070-8341f0b2cf23 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118602024-11-18T21:12:34.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f6cd7c3-24ec-4b39-8070-8341f0b2cf23 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118612024-11-18T21:12:35.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f30211-d6c9-4b3a-971e-ab6347778c82 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118622024-11-18T21:12:35.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f30211-d6c9-4b3a-971e-ab6347778c82 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118632024-11-18T21:12:35.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2f30211-d6c9-4b3a-971e-ab6347778c82 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
118642024-11-18T21:12:35.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 710 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 4b72e284-d2a6-4a83-93f8-9c954cc21b25 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
118652024-11-18T21:12:36.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
118662024-11-18T21:12:36.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
118672024-11-18T21:12:36.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
118682024-11-18T21:12:36.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118692024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118702024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118712024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
118722024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
118732024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118742024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
118752024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118762024-11-18T21:12:36.244ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118772024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118782024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
118792024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
118802024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118812024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
118822024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
118832024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118842024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
118852024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
118862024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
118872024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
118882024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118892024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
118902024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118912024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
118922024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
118932024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118942024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118952024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
118962024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
118972024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118982024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
118992024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
119002024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119012024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119022024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119032024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119042024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119052024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119062024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119072024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119082024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119092024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119102024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119112024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119122024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119132024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119142024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119152024-11-18T21:12:36.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119162024-11-18T21:12:36.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 556406765 } })
119172024-11-18T21:12:36.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
119182024-11-18T21:12:36.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 557056760 } })
119192024-11-18T21:12:36.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
119202024-11-18T21:12:36.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119212024-11-18T21:12:36.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119222024-11-18T21:12:36.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119232024-11-18T21:12:36.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119242024-11-18T21:12:36.248ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.573554ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
119252024-11-18T21:12:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
119262024-11-18T21:12:36.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119272024-11-18T21:12:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119282024-11-18T21:12:36.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119292024-11-18T21:12:36.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119302024-11-18T21:12:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119312024-11-18T21:12:36.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119322024-11-18T21:12:36.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119332024-11-18T21:12:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119342024-11-18T21:12:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
119352024-11-18T21:12:36.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119362024-11-18T21:12:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119372024-11-18T21:12:36.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119382024-11-18T21:12:36.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119392024-11-18T21:12:36.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119402024-11-18T21:12:36.256ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119412024-11-18T21:12:36.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119422024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119432024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119442024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
119452024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119462024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119472024-11-18T21:12:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119482024-11-18T21:12:36.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119492024-11-18T21:12:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119502024-11-18T21:12:36.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119512024-11-18T21:12:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119522024-11-18T21:12:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119532024-11-18T21:12:36.261ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 571653648 } })
119542024-11-18T21:12:36.261ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
119552024-11-18T21:12:36.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119562024-11-18T21:12:36.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 19.114693ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119572024-11-18T21:12:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119582024-11-18T21:12:36.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119592024-11-18T21:12:36.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119602024-11-18T21:12:36.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119612024-11-18T21:12:36.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119622024-11-18T21:12:36.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119632024-11-18T21:12:36.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119642024-11-18T21:12:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119652024-11-18T21:12:36.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119662024-11-18T21:12:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119672024-11-18T21:12:36.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
119682024-11-18T21:12:36.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119692024-11-18T21:12:36.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119702024-11-18T21:12:36.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.060479ms iteration = 27 status = {"physical_disks_added":0}
119712024-11-18T21:12:36.283ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
119722024-11-18T21:12:36.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.162162ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
119732024-11-18T21:12:36.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.571803ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
119742024-11-18T21:12:36.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.271278ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
119752024-11-18T21:12:36.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119762024-11-18T21:12:36.287ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119772024-11-18T21:12:36.287ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119782024-11-18T21:12:36.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119792024-11-18T21:12:36.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119802024-11-18T21:12:36.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119812024-11-18T21:12:36.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.091717ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119822024-11-18T21:12:36.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119832024-11-18T21:12:36.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119842024-11-18T21:12:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119852024-11-18T21:12:36.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119862024-11-18T21:12:36.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119872024-11-18T21:12:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119882024-11-18T21:12:36.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119892024-11-18T21:12:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119902024-11-18T21:12:36.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c59c927-880b-4319-a8eb-4ddaae48eec9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
119912024-11-18T21:12:36.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c59c927-880b-4319-a8eb-4ddaae48eec9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
119922024-11-18T21:12:36.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119932024-11-18T21:12:36.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119942024-11-18T21:12:36.319ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
119952024-11-18T21:12:36.319ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119962024-11-18T21:12:36.319ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ced1f38f-7373-484c-a11a-8ec1d850846c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
119972024-11-18T21:12:36.319ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119982024-11-18T21:12:36.320ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
119992024-11-18T21:12:36.320ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120002024-11-18T21:12:36.320ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee832735-602d-477b-aedb-71e22afdcc08", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
120012024-11-18T21:12:36.320ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120022024-11-18T21:12:36.321ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120032024-11-18T21:12:36.322ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120042024-11-18T21:12:36.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
120052024-11-18T21:12:36.346ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120062024-11-18T21:12:36.347ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c38dc70-dbd7-4872-b55d-3db1bccbf402", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
120072024-11-18T21:12:36.347ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120082024-11-18T21:12:36.349ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
120092024-11-18T21:12:36.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120102024-11-18T21:12:36.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120112024-11-18T21:12:36.364ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/b0157dea-ec31-4457-96e1-5fc35491c963/state
120122024-11-18T21:12:36.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.610879ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
120132024-11-18T21:12:36.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.941632ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
120142024-11-18T21:12:36.365ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120152024-11-18T21:12:36.365ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120162024-11-18T21:12:36.365ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120172024-11-18T21:12:36.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120182024-11-18T21:12:36.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120192024-11-18T21:12:36.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120202024-11-18T21:12:36.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c59c927-880b-4319-a8eb-4ddaae48eec9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
120212024-11-18T21:12:36.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120222024-11-18T21:12:36.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120232024-11-18T21:12:36.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120242024-11-18T21:12:36.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
120252024-11-18T21:12:36.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120262024-11-18T21:12:36.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120272024-11-18T21:12:36.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b0157dea-ec31-4457-96e1-5fc35491c963/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "73a66f2a-80e2-4775-865c-426b6e87f948", "content-length": "130", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120282024-11-18T21:12:36.387ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d sled_id = 79cbda5a-2e27-489e-945d-860d86dec819 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-18T21:12:31.109256498Z }, migration_in: None, migration_out: None } vmm_id = b0157dea-ec31-4457-96e1-5fc35491c963
120292024-11-18T21:12:36.387ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 sled_id = 79cbda5a-2e27-489e-945d-860d86dec819 vmm_id = b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-18T21:12:31.109256498Z }
120302024-11-18T21:12:36.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d roles = RoleSet { roles: {} } sled_id = 79cbda5a-2e27-489e-945d-860d86dec819 vmm_id = b0157dea-ec31-4457-96e1-5fc35491c963
120312024-11-18T21:12:36.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d resource = Database result = Ok(()) sled_id = 79cbda5a-2e27-489e-945d-860d86dec819 vmm_id = b0157dea-ec31-4457-96e1-5fc35491c963
120322024-11-18T21:12:36.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120332024-11-18T21:12:36.411ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120342024-11-18T21:12:36.411ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120352024-11-18T21:12:36.411ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.025006ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120362024-11-18T21:12:36.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120372024-11-18T21:12:36.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120382024-11-18T21:12:36.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120392024-11-18T21:12:36.433ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120402024-11-18T21:12:36.433ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7060b7b6-bd48-4ec7-b487-638fb3247705", "content-length": "1", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120412024-11-18T21:12:36.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120422024-11-18T21:12:36.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120432024-11-18T21:12:36.444ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.683737ms iteration = 24 status = {}
120442024-11-18T21:12:36.525ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120452024-11-18T21:12:36.525ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120462024-11-18T21:12:36.525ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "82cc624b-2b2d-406d-ae5c-bb4e1bd5fdbf", "content-length": "585", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120472024-11-18T21:12:36.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120482024-11-18T21:12:36.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120492024-11-18T21:12:36.527ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 283.214762ms iteration = 24 status = 0
120502024-11-18T21:12:36.529ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 285.64827ms iteration = 24 status = null
120512024-11-18T21:12:36.530ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
120522024-11-18T21:12:36.533ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 288.984706ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
120532024-11-18T21:12:36.572ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {22b961b8-9080-4e1f-8bc7-6427df717a9f: {10.151.2.175: {3ac43a21-5b43-44f3-aa9c-4f7a4e11405c}, 10.151.2.176: {3ac43a21-5b43-44f3-aa9c-4f7a4e11405c}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
120542024-11-18T21:12:36.572ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120552024-11-18T21:12:36.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120562024-11-18T21:12:36.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120572024-11-18T21:12:36.583ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
120582024-11-18T21:12:36.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120592024-11-18T21:12:36.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120602024-11-18T21:12:36.593ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120612024-11-18T21:12:36.593ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "91ba086d-f5d5-40df-a913-c1467e8f6de6", "content-length": "134", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120622024-11-18T21:12:36.593ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120632024-11-18T21:12:36.593ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
120642024-11-18T21:12:36.593ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120652024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120662024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120672024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120682024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120692024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120702024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120712024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120722024-11-18T21:12:36.594ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
120732024-11-18T21:12:36.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120742024-11-18T21:12:36.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120752024-11-18T21:12:36.616ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120762024-11-18T21:12:36.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120772024-11-18T21:12:36.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6b444d6-a53a-4b3f-af78-5b4854acb9a4", "content-length": "2", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120782024-11-18T21:12:36.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120792024-11-18T21:12:36.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1000464-fcdd-4274-8b60-ef0590d1d1c5", "content-length": "51", "date": "Mon, 18 Nov 2024 21:12:35 GMT"} })
120802024-11-18T21:12:36.618ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
120812024-11-18T21:12:36.618ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120822024-11-18T21:12:36.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4a940304-69d4-41cc-bbe8-0198cab2d7fa", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
120832024-11-18T21:12:36.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120842024-11-18T21:12:36.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120852024-11-18T21:12:36.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8ce3ab0-f4ad-48e9-9e76-c8eadccd4ffc", "content-length": "811", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
120862024-11-18T21:12:36.667ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(15890920) }} sled = sock
120872024-11-18T21:12:36.667ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
120882024-11-18T21:12:36.667ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
120892024-11-18T21:12:36.669ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.084861ms iteration = 24 status = {}
120902024-11-18T21:12:36.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120912024-11-18T21:12:36.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120922024-11-18T21:12:36.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120932024-11-18T21:12:36.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120942024-11-18T21:12:36.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120952024-11-18T21:12:36.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120962024-11-18T21:12:36.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120972024-11-18T21:12:36.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120982024-11-18T21:12:36.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120992024-11-18T21:12:36.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121002024-11-18T21:12:36.683ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
121012024-11-18T21:12:36.683ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
121022024-11-18T21:12:36.683ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
121032024-11-18T21:12:36.690ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6cc72d73-ca7d-4266-8bbd-0da949759bdc", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
121042024-11-18T21:12:36.691ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 447.522348ms iteration = 24 status = {}
121052024-11-18T21:12:36.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff43fcfc-1b61-4944-95ee-dc632905e829", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
121062024-11-18T21:12:36.769ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
121072024-11-18T21:12:36.769ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121082024-11-18T21:12:36.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "468aede3-08ac-4444-aea7-989d76ba7f21", "content-length": "682", "date": "Mon, 18 Nov 2024 21:12:36 GMT"} })
121092024-11-18T21:12:36.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121102024-11-18T21:12:36.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121112024-11-18T21:12:36.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121122024-11-18T21:12:36.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121132024-11-18T21:12:36.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121142024-11-18T21:12:36.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121152024-11-18T21:12:36.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121162024-11-18T21:12:36.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121172024-11-18T21:12:36.786ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 542.387974ms iteration = 24 status = {}
121182024-11-18T21:12:37.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7639b66f-dd6f-4957-a401-c1558a9cf8be roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121192024-11-18T21:12:37.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7639b66f-dd6f-4957-a401-c1558a9cf8be resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121202024-11-18T21:12:37.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7639b66f-dd6f-4957-a401-c1558a9cf8be response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121212024-11-18T21:12:38.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dafa5b-eca6-4ab3-b1ad-6e00b0ddc83a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121222024-11-18T21:12:38.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dafa5b-eca6-4ab3-b1ad-6e00b0ddc83a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121232024-11-18T21:12:38.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dafa5b-eca6-4ab3-b1ad-6e00b0ddc83a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121242024-11-18T21:12:39.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44697348-3e3c-4c1e-a188-1a326e110138 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121252024-11-18T21:12:39.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44697348-3e3c-4c1e-a188-1a326e110138 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121262024-11-18T21:12:39.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 44697348-3e3c-4c1e-a188-1a326e110138 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121272024-11-18T21:12:40.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cecfd15c-20fc-4133-acc7-ef485399ff15 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121282024-11-18T21:12:40.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cecfd15c-20fc-4133-acc7-ef485399ff15 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121292024-11-18T21:12:40.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cecfd15c-20fc-4133-acc7-ef485399ff15 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121302024-11-18T21:12:40.921ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41a95664-b42e-4407-9291-6bbd3a339942 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-18T21:12:40.921402526Z }
121312024-11-18T21:12:40.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41a95664-b42e-4407-9291-6bbd3a339942 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121322024-11-18T21:12:40.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41a95664-b42e-4407-9291-6bbd3a339942 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121332024-11-18T21:12:40.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48978 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41a95664-b42e-4407-9291-6bbd3a339942 response_code = 204 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121342024-11-18T21:12:41.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 12d05bad-5473-416c-949c-6fec71647e4d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121352024-11-18T21:12:41.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 12d05bad-5473-416c-949c-6fec71647e4d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121362024-11-18T21:12:41.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 12d05bad-5473-416c-949c-6fec71647e4d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121372024-11-18T21:12:42.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11d08a97-97eb-4641-a928-3ec97928fd9b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121382024-11-18T21:12:42.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11d08a97-97eb-4641-a928-3ec97928fd9b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121392024-11-18T21:12:42.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11d08a97-97eb-4641-a928-3ec97928fd9b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121402024-11-18T21:12:43.435ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-18T21:12:43.435169854Z }
121412024-11-18T21:12:43.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121422024-11-18T21:12:43.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121432024-11-18T21:12:43.444ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_needs_update = true
121442024-11-18T21:12:43.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121452024-11-18T21:12:43.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121462024-11-18T21:12:43.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121472024-11-18T21:12:43.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121482024-11-18T21:12:43.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121492024-11-18T21:12:43.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121502024-11-18T21:12:43.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121512024-11-18T21:12:43.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121522024-11-18T21:12:43.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121532024-11-18T21:12:43.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121542024-11-18T21:12:43.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121552024-11-18T21:12:43.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121562024-11-18T21:12:43.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121572024-11-18T21:12:43.466ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, lookup_type: ById(ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8) }, key: 53281266-8693-4b0d-8c79-19e20f52ead1, lookup_type: ById(53281266-8693-4b0d-8c79-19e20f52ead1) }, key: 229c467e-2b02-41ee-af58-c382cbfa394d, lookup_type: ById(229c467e-2b02-41ee-af58-c382cbfa394d) } result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121582024-11-18T21:12:43.474ZINFOnexus (dropshot_internal): starting update saga for 229c467e-2b02-41ee-af58-c382cbfa394d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-18T21:12:43.435169854Z }
121592024-11-18T21:12:43.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38726 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 response_code = 204 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121602024-11-18T21:12:43.474ZDEBGnexus (dropshot_internal): preparing instance-update saga for 229c467e-2b02-41ee-af58-c382cbfa394d... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2f8b8a91-6d1d-4f2c-8d4a-2d5ffdb39849 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121612024-11-18T21:12:43.474ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update
121622024-11-18T21:12:43.474ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 420e7e43-8a54-4d65-befe-93d7aedc12b2 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-18T21:12:43.435169854Z }
121632024-11-18T21:12:43.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 420e7e43-8a54-4d65-befe-93d7aedc12b2 roles = RoleSet { roles: {} } uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121642024-11-18T21:12:43.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 420e7e43-8a54-4d65-befe-93d7aedc12b2 resource = Database result = Ok(()) uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121652024-11-18T21:12:43.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3992 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 420e7e43-8a54-4d65-befe-93d7aedc12b2 response_code = 204 uri = /vmms/b0157dea-ec31-4457-96e1-5fc35491c963
121662024-11-18T21:12:43.478ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"229c467e-2b02-41ee-af58-c382cbfa394d","lookup_type":{"ById":"229c467e-2b02-41ee-af58-c382cbfa394d"},"parent":{"key":"53281266-8693-4b0d-8c79-19e20f52ead1","lookup_type":{"ById":"53281266-8693-4b0d-8c79-19e20f52ead1"},"parent":{"key":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","lookup_type":{"ById":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121672024-11-18T21:12:43.478ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update
121682024-11-18T21:12:43.520ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update
121692024-11-18T21:12:43.520ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121702024-11-18T21:12:43.520ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121712024-11-18T21:12:43.520ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
121722024-11-18T21:12:43.525ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121732024-11-18T21:12:43.525ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
121742024-11-18T21:12:43.528ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121752024-11-18T21:12:43.528ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
121762024-11-18T21:12:43.533ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121772024-11-18T21:12:43.533ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("70518ae2-179c-496a-8515-b3da20f013d1")) node_id = 0 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
121782024-11-18T21:12:43.537ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
121792024-11-18T21:12:43.537ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
121802024-11-18T21:12:43.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fad44ef-0e6d-4a07-85fa-0d4748d8e712 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121812024-11-18T21:12:43.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fad44ef-0e6d-4a07-85fa-0d4748d8e712 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121822024-11-18T21:12:43.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0fad44ef-0e6d-4a07-85fa-0d4748d8e712 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
121832024-11-18T21:12:43.550ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update
121842024-11-18T21:12:43.555ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121852024-11-18T21:12:43.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121862024-11-18T21:12:43.557ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121872024-11-18T21:12:43.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121882024-11-18T21:12:43.559ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121892024-11-18T21:12:43.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121902024-11-18T21:12:43.564ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121912024-11-18T21:12:43.564ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121922024-11-18T21:12:43.565ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121932024-11-18T21:12:43.566ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121942024-11-18T21:12:43.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121952024-11-18T21:12:43.567ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121962024-11-18T21:12:43.569ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121972024-11-18T21:12:43.574ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, lookup_type: ById(ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8) }, key: 53281266-8693-4b0d-8c79-19e20f52ead1, lookup_type: ById(53281266-8693-4b0d-8c79-19e20f52ead1) }, key: 229c467e-2b02-41ee-af58-c382cbfa394d, lookup_type: ById(229c467e-2b02-41ee-af58-c382cbfa394d) } result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
121982024-11-18T21:12:43.574ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance updater_id = 70518ae2-179c-496a-8515-b3da20f013d1
121992024-11-18T21:12:43.574ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
122002024-11-18T21:12:43.574ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
122012024-11-18T21:12:43.586ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance updater_id = 70518ae2-179c-496a-8515-b3da20f013d1
122022024-11-18T21:12:43.586ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
122032024-11-18T21:12:43.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance
122042024-11-18T21:12:43.590ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d locked_gen = Generation(Generation(2)) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = LockInstance updater_id = 70518ae2-179c-496a-8515-b3da20f013d1
122052024-11-18T21:12:43.590ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122062024-11-18T21:12:43.590ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("70518ae2-179c-496a-8515-b3da20f013d1")}) node_id = 1 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
122072024-11-18T21:12:43.594ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122082024-11-18T21:12:43.594ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
122092024-11-18T21:12:43.604ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122102024-11-18T21:12:43.604ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122112024-11-18T21:12:43.605ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122122024-11-18T21:12:43.606ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122132024-11-18T21:12:43.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122142024-11-18T21:12:43.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122152024-11-18T21:12:43.608ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122162024-11-18T21:12:43.611ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, lookup_type: ById(ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8) }, key: 53281266-8693-4b0d-8c79-19e20f52ead1, lookup_type: ById(53281266-8693-4b0d-8c79-19e20f52ead1) }, key: 229c467e-2b02-41ee-af58-c382cbfa394d, lookup_type: ById(229c467e-2b02-41ee-af58-c382cbfa394d) } result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122172024-11-18T21:12:43.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122182024-11-18T21:12:43.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
122192024-11-18T21:12:43.621ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b0157dea-ec31-4457-96e1-5fc35491c963, time_created: 2024-11-18T21:12:22.921352Z, time_deleted: None, instance_id: 229c467e-2b02-41ee-af58-c382cbfa394d, sled_id: 79cbda5a-2e27-489e-945d-860d86dec819, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-18T21:12:43.435169Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-18T21:12:20.657656Z, gen: Generation(Generation(3)), propolis_id: Some(b0157dea-ec31-4457-96e1-5fc35491c963), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b0157dea-ec31-4457-96e1-5fc35491c963 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-18T21:12:43.621894496Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
122202024-11-18T21:12:43.622ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122212024-11-18T21:12:43.622ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"229c467e-2b02-41ee-af58-c382cbfa394d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b0157dea-ec31-4457-96e1-5fc35491c963"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"229c467e-2b02-41ee-af58-c382cbfa394d","lookup_type":{"ById":"229c467e-2b02-41ee-af58-c382cbfa394d"},"parent":{"key":"53281266-8693-4b0d-8c79-19e20f52ead1","lookup_type":{"ById":"53281266-8693-4b0d-8c79-19e20f52ead1"},"parent":{"key":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","lookup_type":{"ById":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"70518ae2-179c-496a-8515-b3da20f013d1"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"53281266-8693-4b0d-8c79-19e20f52ead1","ram_diff":1073741824},"destroy_active_vmm":"b0157dea-ec31-4457-96e1-5fc35491c963","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-18T21:12:43.621894496Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122222024-11-18T21:12:43.622ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122232024-11-18T21:12:43.653ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122242024-11-18T21:12:43.653ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122252024-11-18T21:12:43.653ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122262024-11-18T21:12:43.653ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122272024-11-18T21:12:43.658ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122282024-11-18T21:12:43.658ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122292024-11-18T21:12:43.662ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122302024-11-18T21:12:43.662ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122312024-11-18T21:12:43.665ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122322024-11-18T21:12:43.665ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c51a9fce-5fde-4633-a411-b7e9d4462a11")) node_id = 0 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122332024-11-18T21:12:43.668ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122342024-11-18T21:12:43.669ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122352024-11-18T21:12:43.675ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d parent_lock = UpdaterLock { updater_id: 70518ae2-179c-496a-8515-b3da20f013d1, locked_gen: Generation(Generation(2)) } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122362024-11-18T21:12:43.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = BecomeUpdater
122372024-11-18T21:12:43.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = BecomeUpdater
122382024-11-18T21:12:43.686ZDEBGnexus (SagaExecutor): inherited lock from 70518ae2-179c-496a-8515-b3da20f013d1 to c51a9fce-5fde-4633-a411-b7e9d4462a11 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 70518ae2-179c-496a-8515-b3da20f013d1 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = BecomeUpdater updater_id = c51a9fce-5fde-4633-a411-b7e9d4462a11
122392024-11-18T21:12:43.686ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122402024-11-18T21:12:43.686ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122412024-11-18T21:12:43.686ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c51a9fce-5fde-4633-a411-b7e9d4462a11")}) node_id = 1 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122422024-11-18T21:12:43.689ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122432024-11-18T21:12:43.689ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122442024-11-18T21:12:43.692ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122452024-11-18T21:12:43.692ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122462024-11-18T21:12:43.696ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122472024-11-18T21:12:43.696ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122482024-11-18T21:12:43.701ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122492024-11-18T21:12:43.703ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d
122502024-11-18T21:12:43.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122512024-11-18T21:12:43.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122522024-11-18T21:12:43.706ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122532024-11-18T21:12:43.706ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122542024-11-18T21:12:43.710ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
122552024-11-18T21:12:43.710ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122562024-11-18T21:12:43.711ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UpdateNetworkConfig
122572024-11-18T21:12:43.712ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
122582024-11-18T21:12:43.712ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
122592024-11-18T21:12:43.712ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
122602024-11-18T21:12:43.714ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
122612024-11-18T21:12:43.715ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
122622024-11-18T21:12:43.715ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
122632024-11-18T21:12:43.715ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
122642024-11-18T21:12:43.719ZDEBGnexus: notifying dendrite of updates instance_id = Some(229c467e-2b02-41ee-af58-c382cbfa394d (instance)) switch = switch0
122652024-11-18T21:12:43.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 30199434 } })
122662024-11-18T21:12:43.720ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
122672024-11-18T21:12:43.750ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
122682024-11-18T21:12:43.750ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122692024-11-18T21:12:43.751ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94da62aa-462b-4bdc-be2e-1eae2d9d22be", "content-length": "26", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} })
122702024-11-18T21:12:43.751ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122712024-11-18T21:12:43.751ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122722024-11-18T21:12:43.780ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
122732024-11-18T21:12:43.780ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3436fd8-8828-4fe4-bf5e-dcc1ad5575b9", "content-length": "4", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} })
122742024-11-18T21:12:43.781ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122752024-11-18T21:12:43.781ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122762024-11-18T21:12:43.784ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122772024-11-18T21:12:43.784ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122782024-11-18T21:12:43.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
122792024-11-18T21:12:43.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
122802024-11-18T21:12:43.808ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-18T21:12:43.795454Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 53281266-8693-4b0d-8c79-19e20f52ead1, time_modified: Some(2024-11-18T21:12:43.795454Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, time_modified: Some(2024-11-18T21:12:43.795454Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122812024-11-18T21:12:43.808ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122822024-11-18T21:12:43.808ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122832024-11-18T21:12:43.811ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122842024-11-18T21:12:43.811ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122852024-11-18T21:12:43.815ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122862024-11-18T21:12:43.815ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UnassignOximeterProducer
122872024-11-18T21:12:43.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UnassignOximeterProducer
122882024-11-18T21:12:43.820ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 producer_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122892024-11-18T21:12:43.820ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UnassignOximeterProducer
122902024-11-18T21:12:43.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = UnassignOximeterProducer
122912024-11-18T21:12:43.858ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122922024-11-18T21:12:43.862ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/229c467e-2b02-41ee-af58-c382cbfa394d
122932024-11-18T21:12:43.878ZDEBGnexus (SagaExecutor): client response oximeter-collector = 229c467e-2b02-41ee-af58-c382cbfa394d result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/229c467e-2b02-41ee-af58-c382cbfa394d", status: 204, headers: {"x-request-id": "726ff6f9-7f15-471f-a81e-adeb9061e0a5", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} }) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122942024-11-18T21:12:43.878ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 producer_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
122952024-11-18T21:12:43.881ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122962024-11-18T21:12:43.881ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122972024-11-18T21:12:43.884ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
122982024-11-18T21:12:43.884ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
122992024-11-18T21:12:43.888ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d lock = UpdaterLock { updater_id: c51a9fce-5fde-4633-a411-b7e9d4462a11, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-18T21:12:43.621894496Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
123002024-11-18T21:12:43.888ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = CommitInstanceUpdates
123012024-11-18T21:12:43.888ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = CommitInstanceUpdates
123022024-11-18T21:12:43.903ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d new_runtime = InstanceRuntimeState { time_updated: 2024-11-18T21:12:43.621894496Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
123032024-11-18T21:12:43.903ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123042024-11-18T21:12:43.903ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123052024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
123062024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
123072024-11-18T21:12:43.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
123082024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123092024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123102024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123112024-11-18T21:12:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123122024-11-18T21:12:43.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123132024-11-18T21:12:43.906ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123142024-11-18T21:12:43.906ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123152024-11-18T21:12:43.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123162024-11-18T21:12:43.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123172024-11-18T21:12:43.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123182024-11-18T21:12:43.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123192024-11-18T21:12:43.909ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123202024-11-18T21:12:43.909ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("229c467e-2b02-41ee-af58-c382cbfa394d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b0157dea-ec31-4457-96e1-5fc35491c963")}) node_id = 7 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123212024-11-18T21:12:43.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123222024-11-18T21:12:43.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123232024-11-18T21:12:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123242024-11-18T21:12:43.912ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123252024-11-18T21:12:43.912ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123262024-11-18T21:12:43.915ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123272024-11-18T21:12:43.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123282024-11-18T21:12:43.919ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123292024-11-18T21:12:43.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123302024-11-18T21:12:43.923ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
123312024-11-18T21:12:43.923ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ReleaseSledResources
123322024-11-18T21:12:43.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ReleaseSledResources
123332024-11-18T21:12:43.939ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123342024-11-18T21:12:43.939ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123352024-11-18T21:12:43.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123362024-11-18T21:12:43.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123372024-11-18T21:12:43.943ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123382024-11-18T21:12:43.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123392024-11-18T21:12:43.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c594d77a-e4fb-4ebe-a8d0-9f9d1d7494b5", "content-length": "372", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} })
123402024-11-18T21:12:43.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123412024-11-18T21:12:43.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123422024-11-18T21:12:43.948ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123432024-11-18T21:12:43.948ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123442024-11-18T21:12:43.951ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d propolis_id = b0157dea-ec31-4457-96e1-5fc35491c963 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
123452024-11-18T21:12:43.951ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = MarkVmmDeleted
123462024-11-18T21:12:43.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123472024-11-18T21:12:43.951ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = MarkVmmDeleted
123482024-11-18T21:12:43.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123492024-11-18T21:12:43.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123502024-11-18T21:12:43.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123512024-11-18T21:12:43.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123522024-11-18T21:12:43.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123532024-11-18T21:12:43.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123542024-11-18T21:12:43.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123552024-11-18T21:12:43.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123562024-11-18T21:12:43.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123572024-11-18T21:12:43.961ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123582024-11-18T21:12:43.961ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123592024-11-18T21:12:43.965ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123602024-11-18T21:12:43.965ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123612024-11-18T21:12:43.969ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123622024-11-18T21:12:43.969ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123632024-11-18T21:12:43.976ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123642024-11-18T21:12:43.976ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123652024-11-18T21:12:43.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123662024-11-18T21:12:43.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123672024-11-18T21:12:44.016ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123682024-11-18T21:12:44.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123692024-11-18T21:12:44.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123702024-11-18T21:12:44.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123712024-11-18T21:12:44.020ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123722024-11-18T21:12:44.024ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, lookup_type: ById(ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8) }, key: 53281266-8693-4b0d-8c79-19e20f52ead1, lookup_type: ById(53281266-8693-4b0d-8c79-19e20f52ead1) }, key: 229c467e-2b02-41ee-af58-c382cbfa394d, lookup_type: ById(229c467e-2b02-41ee-af58-c382cbfa394d) } result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123732024-11-18T21:12:44.024ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123742024-11-18T21:12:44.024ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_node = ChainSuccessorSaga
123752024-11-18T21:12:44.029ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d karmic_state = WillReincarnate needs_reincarnation = false saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update
123762024-11-18T21:12:44.029ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123772024-11-18T21:12:44.029ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123782024-11-18T21:12:44.033ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123792024-11-18T21:12:44.033ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123802024-11-18T21:12:44.035ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
123812024-11-18T21:12:44.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123822024-11-18T21:12:44.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "401c3ad1-497d-46ce-b657-94c8d8592e48", "date": "Mon, 18 Nov 2024 21:12:44 GMT"} })
123832024-11-18T21:12:44.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123842024-11-18T21:12:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123852024-11-18T21:12:44.038ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123862024-11-18T21:12:44.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123872024-11-18T21:12:44.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123882024-11-18T21:12:44.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123892024-11-18T21:12:44.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123902024-11-18T21:12:44.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123912024-11-18T21:12:44.042ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
123922024-11-18T21:12:44.042ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f
123932024-11-18T21:12:44.044ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
123942024-11-18T21:12:44.044ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123952024-11-18T21:12:44.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a315b134-54a7-4f59-b72d-8c0f859c13d0", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} })
123962024-11-18T21:12:44.046ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 142.692454ms iteration = 25 status = {}
123972024-11-18T21:12:44.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123982024-11-18T21:12:44.054ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b464e841-e8d9-4c96-94e4-c1111b435610", "content-length": "691", "date": "Mon, 18 Nov 2024 21:12:43 GMT"} })
123992024-11-18T21:12:44.054ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
124002024-11-18T21:12:44.054ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
124012024-11-18T21:12:44.054ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
124022024-11-18T21:12:44.055ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 152.168975ms iteration = 25 status = {}
124032024-11-18T21:12:44.086ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124042024-11-18T21:12:44.086ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f saga_name = instance-update saga_result = SagaResult { saga_id: 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f, saga_log: SagaLog { saga_id: 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("c51a9fce-5fde-4633-a411-b7e9d4462a11")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c51a9fce-5fde-4633-a411-b7e9d4462a11")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("229c467e-2b02-41ee-af58-c382cbfa394d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b0157dea-ec31-4457-96e1-5fc35491c963")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("229c467e-2b02-41ee-af58-c382cbfa394d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b0157dea-ec31-4457-96e1-5fc35491c963")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c51a9fce-5fde-4633-a411-b7e9d4462a11"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c51a9fce-5fde-4633-a411-b7e9d4462a11")}} }) }
124052024-11-18T21:12:44.086ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 8f4174bb-8c5c-4fa2-ac17-1f6adf40542f instance_id = 229c467e-2b02-41ee-af58-c382cbfa394d saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update
124062024-11-18T21:12:44.086ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124072024-11-18T21:12:44.086ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
124082024-11-18T21:12:44.089ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124092024-11-18T21:12:44.089ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
124102024-11-18T21:12:44.093ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124112024-11-18T21:12:44.093ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
124122024-11-18T21:12:44.096ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124132024-11-18T21:12:44.096ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d
124142024-11-18T21:12:44.103ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update sec_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
124152024-11-18T21:12:44.103ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 0cf42659-0eee-4522-a27e-050be307bd7d saga_name = start-instance-update saga_result = SagaResult { saga_id: 0cf42659-0eee-4522-a27e-050be307bd7d, saga_log: SagaLog { saga_id: 0cf42659-0eee-4522-a27e-050be307bd7d, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("70518ae2-179c-496a-8515-b3da20f013d1")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("70518ae2-179c-496a-8515-b3da20f013d1")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("70518ae2-179c-496a-8515-b3da20f013d1"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("70518ae2-179c-496a-8515-b3da20f013d1")}} }) }
124162024-11-18T21:12:44.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 463c5d36-b132-43c3-82b2-13db1f8340b6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124172024-11-18T21:12:44.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 463c5d36-b132-43c3-82b2-13db1f8340b6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124182024-11-18T21:12:44.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 463c5d36-b132-43c3-82b2-13db1f8340b6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124192024-11-18T21:12:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aee4b64e-8acd-415d-a496-c27fa3ea4f96 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124202024-11-18T21:12:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aee4b64e-8acd-415d-a496-c27fa3ea4f96 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124212024-11-18T21:12:45.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aee4b64e-8acd-415d-a496-c27fa3ea4f96 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124222024-11-18T21:12:46.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
124232024-11-18T21:12:46.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124242024-11-18T21:12:46.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
124252024-11-18T21:12:46.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124262024-11-18T21:12:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124272024-11-18T21:12:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124282024-11-18T21:12:46.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124292024-11-18T21:12:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124302024-11-18T21:12:46.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124312024-11-18T21:12:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124322024-11-18T21:12:46.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124332024-11-18T21:12:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124342024-11-18T21:12:46.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124352024-11-18T21:12:46.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124362024-11-18T21:12:46.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124372024-11-18T21:12:46.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
124382024-11-18T21:12:46.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124392024-11-18T21:12:46.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124402024-11-18T21:12:46.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
124412024-11-18T21:12:46.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.526842ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
124422024-11-18T21:12:46.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.697112ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124432024-11-18T21:12:46.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfa9ec2b-edff-4f32-a406-7ab2ae9b4fb4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124442024-11-18T21:12:46.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfa9ec2b-edff-4f32-a406-7ab2ae9b4fb4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124452024-11-18T21:12:46.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfa9ec2b-edff-4f32-a406-7ab2ae9b4fb4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124462024-11-18T21:12:47.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb30e9e-8e56-4589-8c7c-3eeb007a4748 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124472024-11-18T21:12:47.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb30e9e-8e56-4589-8c7c-3eeb007a4748 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124482024-11-18T21:12:47.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cfb30e9e-8e56-4589-8c7c-3eeb007a4748 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124492024-11-18T21:12:48.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0ce8722f-a77a-4892-a0a3-4820c9a49227 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124502024-11-18T21:12:48.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0ce8722f-a77a-4892-a0a3-4820c9a49227 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124512024-11-18T21:12:48.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0ce8722f-a77a-4892-a0a3-4820c9a49227 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124522024-11-18T21:12:49.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04a0699b-1620-4217-a926-3c984b3f09e7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124532024-11-18T21:12:49.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04a0699b-1620-4217-a926-3c984b3f09e7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124542024-11-18T21:12:49.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 04a0699b-1620-4217-a926-3c984b3f09e7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124552024-11-18T21:12:50.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8e7542-933c-468a-abdb-e325273190e1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124562024-11-18T21:12:50.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8e7542-933c-468a-abdb-e325273190e1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124572024-11-18T21:12:50.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = be8e7542-933c-468a-abdb-e325273190e1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124582024-11-18T21:12:50.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3174 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 8fb1af5c-e6e1-4bc0-90ed-78c120207fd6 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
124592024-11-18T21:12:51.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3080c519-6c5b-4046-9847-952d99c578ac roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124602024-11-18T21:12:51.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3080c519-6c5b-4046-9847-952d99c578ac resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124612024-11-18T21:12:51.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3080c519-6c5b-4046-9847-952d99c578ac response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124622024-11-18T21:12:52.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39949627-ee80-4060-a290-3756894d1777 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124632024-11-18T21:12:52.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39949627-ee80-4060-a290-3756894d1777 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124642024-11-18T21:12:52.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39949627-ee80-4060-a290-3756894d1777 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124652024-11-18T21:12:53.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38c5d86c-6ec3-45b3-86c4-71c8c2dcd7a5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124662024-11-18T21:12:53.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38c5d86c-6ec3-45b3-86c4-71c8c2dcd7a5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124672024-11-18T21:12:53.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 38c5d86c-6ec3-45b3-86c4-71c8c2dcd7a5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124682024-11-18T21:12:54.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11c9ec1c-6338-4d10-baf6-5737e00165dd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124692024-11-18T21:12:54.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11c9ec1c-6338-4d10-baf6-5737e00165dd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124702024-11-18T21:12:54.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 11c9ec1c-6338-4d10-baf6-5737e00165dd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124712024-11-18T21:12:55.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c133c057-eb1d-42b9-b7da-e3da063bb7a7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124722024-11-18T21:12:55.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c133c057-eb1d-42b9-b7da-e3da063bb7a7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124732024-11-18T21:12:55.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c133c057-eb1d-42b9-b7da-e3da063bb7a7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124742024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
124752024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124762024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
124772024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124782024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124792024-11-18T21:12:56.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124802024-11-18T21:12:56.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124812024-11-18T21:12:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124822024-11-18T21:12:56.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124832024-11-18T21:12:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124842024-11-18T21:12:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124852024-11-18T21:12:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124862024-11-18T21:12:56.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124872024-11-18T21:12:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124882024-11-18T21:12:56.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.335773ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124892024-11-18T21:12:56.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124902024-11-18T21:12:56.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
124912024-11-18T21:12:56.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124922024-11-18T21:12:56.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124932024-11-18T21:12:56.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
124942024-11-18T21:12:56.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.516762ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
124952024-11-18T21:12:56.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adb86b8d-39e5-4acc-bdc9-4bc7a57afa52 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124962024-11-18T21:12:56.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adb86b8d-39e5-4acc-bdc9-4bc7a57afa52 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124972024-11-18T21:12:56.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = adb86b8d-39e5-4acc-bdc9-4bc7a57afa52 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124982024-11-18T21:12:57.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfce8e98-d0e7-482c-86b6-5b7671123de7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
124992024-11-18T21:12:57.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfce8e98-d0e7-482c-86b6-5b7671123de7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125002024-11-18T21:12:57.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = dfce8e98-d0e7-482c-86b6-5b7671123de7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125012024-11-18T21:12:58.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d944deb-36b2-4b1e-a040-2425388f2c26 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125022024-11-18T21:12:58.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d944deb-36b2-4b1e-a040-2425388f2c26 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125032024-11-18T21:12:58.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9d944deb-36b2-4b1e-a040-2425388f2c26 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125042024-11-18T21:12:59.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb600ce6-3061-4dee-a750-1eadabf1ba2c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125052024-11-18T21:12:59.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb600ce6-3061-4dee-a750-1eadabf1ba2c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125062024-11-18T21:12:59.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fb600ce6-3061-4dee-a750-1eadabf1ba2c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125072024-11-18T21:13:00.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c2cbec6-5f5c-49e2-a653-c03f31e5d463 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125082024-11-18T21:13:00.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c2cbec6-5f5c-49e2-a653-c03f31e5d463 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125092024-11-18T21:13:00.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c2cbec6-5f5c-49e2-a653-c03f31e5d463 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125102024-11-18T21:13:01.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6291060-caf5-4ff5-a1f5-aa04092f2f6d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125112024-11-18T21:13:01.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6291060-caf5-4ff5-a1f5-aa04092f2f6d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125122024-11-18T21:13:01.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b6291060-caf5-4ff5-a1f5-aa04092f2f6d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125132024-11-18T21:13:03.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b41ab81e-e7af-4288-bee1-9c96095b2d1c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125142024-11-18T21:13:03.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b41ab81e-e7af-4288-bee1-9c96095b2d1c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125152024-11-18T21:13:03.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b41ab81e-e7af-4288-bee1-9c96095b2d1c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125162024-11-18T21:13:04.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7f5d083-d3dc-4cae-94ee-688d90bb67f2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125172024-11-18T21:13:04.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7f5d083-d3dc-4cae-94ee-688d90bb67f2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125182024-11-18T21:13:04.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a7f5d083-d3dc-4cae-94ee-688d90bb67f2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125192024-11-18T21:13:05.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a958d1c6-64e9-4997-a0fe-882857ab9c5a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125202024-11-18T21:13:05.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a958d1c6-64e9-4997-a0fe-882857ab9c5a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125212024-11-18T21:13:05.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a958d1c6-64e9-4997-a0fe-882857ab9c5a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125222024-11-18T21:13:05.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 41a9a848-4976-4a0c-969e-467e1b8ccfb4 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
125232024-11-18T21:13:06.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fae6d2-e227-4757-844a-5a9e3fbb7eae roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125242024-11-18T21:13:06.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fae6d2-e227-4757-844a-5a9e3fbb7eae resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125252024-11-18T21:13:06.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 07fae6d2-e227-4757-844a-5a9e3fbb7eae response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
125262024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
125272024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
125282024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
125292024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
125302024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
125312024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
125322024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
125332024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125342024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
125352024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
125362024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
125372024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
125382024-11-18T21:13:06.243ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
125392024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125402024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
125412024-11-18T21:13:06.244ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:03:06.243963710 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
125422024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
125432024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
125442024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
125452024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
125462024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
125472024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125482024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
125492024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125502024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
125512024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
125522024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
125532024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125542024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
125552024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125562024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
125572024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
125582024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
125592024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125602024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
125612024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
125622024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
125632024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
125642024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125652024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
125662024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
125672024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
125682024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
125692024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
125702024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
125712024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125722024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
125732024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
125742024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
125752024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
125762024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125772024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125782024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
125792024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125802024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
125812024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125822024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
125832024-11-18T21:13:06.244ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
125842024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.43\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
125852024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
125862024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125872024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
125882024-11-18T21:13:06.244ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
125892024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
125902024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
125912024-11-18T21:13:06.244ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
125922024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125932024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
125942024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
125952024-11-18T21:13:06.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
125962024-11-18T21:13:06.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 554549521 } })
125972024-11-18T21:13:06.244ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 554588141 } })
125982024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125992024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126002024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126012024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126022024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
126032024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
126042024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126052024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
126062024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126072024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126082024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126092024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126102024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
126112024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126122024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126132024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126142024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126152024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126162024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
126172024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
126182024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126192024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126202024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126212024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
126222024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.597562ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
126232024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
126242024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.780224ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
126252024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126262024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126272024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126282024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126292024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126302024-11-18T21:13:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126312024-11-18T21:13:06.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126322024-11-18T21:13:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126332024-11-18T21:13:06.249ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:03:06.243963710 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
126342024-11-18T21:13:06.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.549632ms iteration = 13 status = {"expiration":"2024-11-18T21:03:06.243963710Z","pruned":[]}
126352024-11-18T21:13:06.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126362024-11-18T21:13:06.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 561189361 } })
126372024-11-18T21:13:06.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 561267501 } })
126382024-11-18T21:13:06.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
126392024-11-18T21:13:06.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
126402024-11-18T21:13:06.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
126412024-11-18T21:13:06.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126422024-11-18T21:13:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126432024-11-18T21:13:06.253ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.986167ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
126442024-11-18T21:13:06.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126452024-11-18T21:13:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126462024-11-18T21:13:06.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126472024-11-18T21:13:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126482024-11-18T21:13:06.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126492024-11-18T21:13:06.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126502024-11-18T21:13:06.261ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.838865ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
126512024-11-18T21:13:06.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126522024-11-18T21:13:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
126532024-11-18T21:13:06.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126542024-11-18T21:13:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126552024-11-18T21:13:06.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126562024-11-18T21:13:06.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126572024-11-18T21:13:06.267ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126582024-11-18T21:13:06.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126592024-11-18T21:13:06.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126602024-11-18T21:13:06.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126612024-11-18T21:13:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
126622024-11-18T21:13:06.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126632024-11-18T21:13:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126642024-11-18T21:13:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
126652024-11-18T21:13:06.271ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
126662024-11-18T21:13:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
126672024-11-18T21:13:06.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126682024-11-18T21:13:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
126692024-11-18T21:13:06.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126702024-11-18T21:13:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126712024-11-18T21:13:06.277ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126722024-11-18T21:13:06.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126732024-11-18T21:13:06.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126742024-11-18T21:13:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
126752024-11-18T21:13:06.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126762024-11-18T21:13:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126772024-11-18T21:13:06.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126782024-11-18T21:13:06.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126792024-11-18T21:13:06.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126802024-11-18T21:13:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126812024-11-18T21:13:06.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
126822024-11-18T21:13:06.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126832024-11-18T21:13:06.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126842024-11-18T21:13:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
126852024-11-18T21:13:06.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.726535ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
126862024-11-18T21:13:06.300ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
126872024-11-18T21:13:06.300ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
126882024-11-18T21:13:06.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126892024-11-18T21:13:06.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
126902024-11-18T21:13:06.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.35412ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126912024-11-18T21:13:06.303ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
126922024-11-18T21:13:06.303ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
126932024-11-18T21:13:06.303ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.777629ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
126942024-11-18T21:13:06.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126952024-11-18T21:13:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126962024-11-18T21:13:06.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126972024-11-18T21:13:06.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126982024-11-18T21:13:06.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126992024-11-18T21:13:06.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.529606ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
127002024-11-18T21:13:06.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
127012024-11-18T21:13:06.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127022024-11-18T21:13:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127032024-11-18T21:13:06.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127042024-11-18T21:13:06.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127052024-11-18T21:13:06.312ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127062024-11-18T21:13:06.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127072024-11-18T21:13:06.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127082024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
127092024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127102024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127112024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127122024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127132024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127142024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127152024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127162024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127172024-11-18T21:13:06.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127182024-11-18T21:13:06.319ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127192024-11-18T21:13:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127202024-11-18T21:13:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127212024-11-18T21:13:06.319ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127222024-11-18T21:13:06.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127232024-11-18T21:13:06.322ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127242024-11-18T21:13:06.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127252024-11-18T21:13:06.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127262024-11-18T21:13:06.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127272024-11-18T21:13:06.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127282024-11-18T21:13:06.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127292024-11-18T21:13:06.327ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127302024-11-18T21:13:06.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127312024-11-18T21:13:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127322024-11-18T21:13:06.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127332024-11-18T21:13:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127342024-11-18T21:13:06.331ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 87.003289ms iteration = 6 status = {"nsuccess":5}
127352024-11-18T21:13:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
127362024-11-18T21:13:06.332ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1695, tv_nsec: 642620558 } })
127372024-11-18T21:13:06.333ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
127382024-11-18T21:13:06.334ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
127392024-11-18T21:13:06.334ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.608748ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
127402024-11-18T21:13:06.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127412024-11-18T21:13:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127422024-11-18T21:13:06.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127432024-11-18T21:13:06.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127442024-11-18T21:13:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127452024-11-18T21:13:06.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127462024-11-18T21:13:06.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127472024-11-18T21:13:06.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127482024-11-18T21:13:06.354ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127492024-11-18T21:13:06.355ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127502024-11-18T21:13:06.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127512024-11-18T21:13:06.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127522024-11-18T21:13:06.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127532024-11-18T21:13:06.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127542024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
127552024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127562024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
127572024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
127582024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
127592024-11-18T21:13:06.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127602024-11-18T21:13:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127612024-11-18T21:13:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
127622024-11-18T21:13:06.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127632024-11-18T21:13:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127642024-11-18T21:13:06.359ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127652024-11-18T21:13:06.359ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127662024-11-18T21:13:06.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127672024-11-18T21:13:06.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127682024-11-18T21:13:06.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
127692024-11-18T21:13:06.360ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127702024-11-18T21:13:06.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127712024-11-18T21:13:06.365ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
127722024-11-18T21:13:06.365ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
127732024-11-18T21:13:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.439148ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
127742024-11-18T21:13:06.365ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.088153ms iteration = 25 status = 0
127752024-11-18T21:13:06.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127762024-11-18T21:13:06.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127772024-11-18T21:13:06.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127782024-11-18T21:13:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.053822ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127792024-11-18T21:13:06.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127802024-11-18T21:13:06.370ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127812024-11-18T21:13:06.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 126.244341ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
127822024-11-18T21:13:06.371ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
127832024-11-18T21:13:06.371ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
127842024-11-18T21:13:06.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127852024-11-18T21:13:06.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127862024-11-18T21:13:06.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127872024-11-18T21:13:06.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.966309ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
127882024-11-18T21:13:06.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127892024-11-18T21:13:06.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127902024-11-18T21:13:06.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127912024-11-18T21:13:06.377ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
127922024-11-18T21:13:06.377ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
127932024-11-18T21:13:06.377ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
127942024-11-18T21:13:06.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.903718ms iteration = 13 status = {"generation":2}
127952024-11-18T21:13:06.379ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
127962024-11-18T21:13:06.379ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
127972024-11-18T21:13:06.379ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
127982024-11-18T21:13:06.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127992024-11-18T21:13:06.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128002024-11-18T21:13:06.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128012024-11-18T21:13:06.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128022024-11-18T21:13:06.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128032024-11-18T21:13:06.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128042024-11-18T21:13:06.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.879981ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
128052024-11-18T21:13:06.397ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128062024-11-18T21:13:06.397ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128072024-11-18T21:13:06.397ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.156392ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128082024-11-18T21:13:06.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
128092024-11-18T21:13:06.398ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128102024-11-18T21:13:06.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128112024-11-18T21:13:06.398ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f16f70a5-b131-4b93-8242-46a15de2b3c7", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128122024-11-18T21:13:06.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128132024-11-18T21:13:06.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128142024-11-18T21:13:06.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128152024-11-18T21:13:06.401ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
128162024-11-18T21:13:06.401ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.949908ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
128172024-11-18T21:13:06.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128182024-11-18T21:13:06.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128192024-11-18T21:13:06.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128202024-11-18T21:13:06.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128212024-11-18T21:13:06.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128222024-11-18T21:13:06.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128232024-11-18T21:13:06.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128242024-11-18T21:13:06.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128252024-11-18T21:13:06.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128262024-11-18T21:13:06.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128272024-11-18T21:13:06.430ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
128282024-11-18T21:13:06.430ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 186.160509ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
128292024-11-18T21:13:06.431ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
128302024-11-18T21:13:06.431ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
128312024-11-18T21:13:06.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128322024-11-18T21:13:06.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128332024-11-18T21:13:06.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128342024-11-18T21:13:06.434ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.236269ms iteration = 28 status = {"physical_disks_added":0}
128352024-11-18T21:13:06.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128362024-11-18T21:13:06.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128372024-11-18T21:13:06.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128382024-11-18T21:13:06.479ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
128392024-11-18T21:13:06.479ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128402024-11-18T21:13:06.479ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01a2ddeb-95dc-43b1-baa7-a835d6671382", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128412024-11-18T21:13:06.479ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128422024-11-18T21:13:06.480ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
128432024-11-18T21:13:06.572ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 328.803083ms iteration = 25 status = {}
128442024-11-18T21:13:06.616ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
128452024-11-18T21:13:06.663ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
128462024-11-18T21:13:06.663ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128472024-11-18T21:13:06.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
128482024-11-18T21:13:06.663ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f566cbe-9fb7-4611-a7a2-67e830908475", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128492024-11-18T21:13:06.663ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128502024-11-18T21:13:06.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128512024-11-18T21:13:06.702ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128522024-11-18T21:13:06.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128532024-11-18T21:13:06.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d61d558-435c-4903-a256-5a51b8532425", "content-length": "372", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128542024-11-18T21:13:06.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128552024-11-18T21:13:06.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128562024-11-18T21:13:06.705ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
128572024-11-18T21:13:06.705ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
128582024-11-18T21:13:06.705ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
128592024-11-18T21:13:06.705ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 461.571882ms iteration = 13 status = {"generation":1}
128602024-11-18T21:13:06.769ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128612024-11-18T21:13:06.769ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d2589d-d551-4afa-9250-7aef48492dbb", "content-length": "691", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128622024-11-18T21:13:06.769ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
128632024-11-18T21:13:06.769ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
128642024-11-18T21:13:06.769ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
128652024-11-18T21:13:06.771ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.93643ms iteration = 26 status = {}
128662024-11-18T21:13:06.802ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
128672024-11-18T21:13:06.802ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e96c247f-774e-44de-a54e-1a7e5b2af272", "content-length": "2", "date": "Mon, 18 Nov 2024 21:13:05 GMT"} })
128682024-11-18T21:13:06.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128692024-11-18T21:13:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128702024-11-18T21:13:06.807ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 563.768124ms iteration = 25 status = null
128712024-11-18T21:13:06.812ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
128722024-11-18T21:13:06.812ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128732024-11-18T21:13:06.813ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5ac8fb5d-a0f1-4b96-b4df-639b88b74a4f", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128742024-11-18T21:13:06.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128752024-11-18T21:13:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128762024-11-18T21:13:06.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128772024-11-18T21:13:06.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128782024-11-18T21:13:06.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128792024-11-18T21:13:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128802024-11-18T21:13:06.822ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128812024-11-18T21:13:06.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128822024-11-18T21:13:06.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8247f3f0-ce42-4fe9-b02b-8953863e248b", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
128832024-11-18T21:13:06.823ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 579.023228ms iteration = 26 status = {}
128842024-11-18T21:13:06.879ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
128852024-11-18T21:13:06.879ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
128862024-11-18T21:13:06.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
128872024-11-18T21:13:06.889ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "807d28da-c247-4af6-bd39-a9d0dc0fb608", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128882024-11-18T21:13:06.889ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128892024-11-18T21:13:06.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2c55c4ff-ad10-4fef-bee6-3b372f8824b7", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128902024-11-18T21:13:06.891ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128912024-11-18T21:13:06.893ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128922024-11-18T21:13:06.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 649.132921ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
128932024-11-18T21:13:06.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
128942024-11-18T21:13:06.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128952024-11-18T21:13:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128962024-11-18T21:13:06.913ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
128972024-11-18T21:13:06.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128982024-11-18T21:13:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128992024-11-18T21:13:06.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
129002024-11-18T21:13:06.923ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40edf465-0af1-4174-8655-ecf792b039fa", "content-length": "134", "date": "Mon, 18 Nov 2024 21:13:05 GMT"} })
129012024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
129022024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
129032024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
129042024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
129052024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129062024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129072024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129082024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129092024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129102024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129112024-11-18T21:13:06.923ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
129122024-11-18T21:13:06.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129132024-11-18T21:13:06.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129142024-11-18T21:13:06.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
129152024-11-18T21:13:06.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77194ac-8a06-46ae-9f2f-4d7aed9555e0", "content-length": "2", "date": "Mon, 18 Nov 2024 21:13:05 GMT"} })
129162024-11-18T21:13:06.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
129172024-11-18T21:13:06.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfc1d565-f947-43c4-8659-e853af32dbc3", "content-length": "51", "date": "Mon, 18 Nov 2024 21:13:05 GMT"} })
129182024-11-18T21:13:06.925ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
129192024-11-18T21:13:06.925ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
129202024-11-18T21:13:06.949ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
129212024-11-18T21:13:06.949ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45418
129222024-11-18T21:13:06.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45418 req_id = 1db055d8-72e4-4ebc-9fc1-c4c7c1092333 roles = RoleSet { roles: {} } uri = /metrics/producers
129232024-11-18T21:13:06.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45418 req_id = 1db055d8-72e4-4ebc-9fc1-c4c7c1092333 resource = Database result = Ok(()) uri = /metrics/producers
129242024-11-18T21:13:06.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
129252024-11-18T21:13:06.955ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "66bd10ec-b90c-474c-9229-1236da3170c9", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129262024-11-18T21:13:06.955ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129272024-11-18T21:13:06.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fab6884c-73e3-4910-a13b-a6d809753f08", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129282024-11-18T21:13:06.957ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129292024-11-18T21:13:06.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5398413f-4101-46c3-9763-e7a4a747c374", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129302024-11-18T21:13:06.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129312024-11-18T21:13:06.960ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
129322024-11-18T21:13:06.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 716.711335ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
129332024-11-18T21:13:06.982ZINFOnexus: assigned collector to new producer collector_id = 84b5a094-9eb0-4ff8-be58-5c4913059740 file = nexus/src/app/oximeter.rs:76 producer_id = 3dce42ed-74cb-4c8b-9326-8273a1efd563
129342024-11-18T21:13:06.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33035 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45418 req_id = 1db055d8-72e4-4ebc-9fc1-c4c7c1092333 response_code = 201 uri = /metrics/producers
129352024-11-18T21:13:06.982ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "1db055d8-72e4-4ebc-9fc1-c4c7c1092333", "content-length": "41", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
129362024-11-18T21:13:06.984ZDEBGnexus (producer-registration-task): registered with nexus successfully
129372024-11-18T21:13:06.984ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
129382024-11-18T21:13:07.027ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "44cc939f-13bb-4824-a0f4-d22dee3fa173", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
129392024-11-18T21:13:07.027ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
129402024-11-18T21:13:07.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
129412024-11-18T21:13:07.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "75757ec4-ab1c-47f1-9633-ea2967ca7896", "content-length": "682", "date": "Mon, 18 Nov 2024 21:13:06 GMT"} })
129422024-11-18T21:13:07.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129432024-11-18T21:13:07.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129442024-11-18T21:13:07.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129452024-11-18T21:13:07.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129462024-11-18T21:13:07.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129472024-11-18T21:13:07.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129482024-11-18T21:13:07.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129492024-11-18T21:13:07.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129502024-11-18T21:13:07.045ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.699912ms iteration = 25 status = {}
129512024-11-18T21:13:07.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37ca338c-2229-4461-a3e8-fa68a623fb72 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129522024-11-18T21:13:07.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37ca338c-2229-4461-a3e8-fa68a623fb72 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129532024-11-18T21:13:07.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37ca338c-2229-4461-a3e8-fa68a623fb72 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129542024-11-18T21:13:08.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d49faa1-2c06-42af-b16d-d2fd6526b438 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129552024-11-18T21:13:08.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d49faa1-2c06-42af-b16d-d2fd6526b438 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129562024-11-18T21:13:08.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8d49faa1-2c06-42af-b16d-d2fd6526b438 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129572024-11-18T21:13:09.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 14bb6e22-99cd-403d-bbf5-7c79c6384ad0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129582024-11-18T21:13:09.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 14bb6e22-99cd-403d-bbf5-7c79c6384ad0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129592024-11-18T21:13:09.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 14bb6e22-99cd-403d-bbf5-7c79c6384ad0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129602024-11-18T21:13:10.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0fc6102-d8f6-4401-aba3-6eb07797ff93 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129612024-11-18T21:13:10.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0fc6102-d8f6-4401-aba3-6eb07797ff93 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129622024-11-18T21:13:10.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d0fc6102-d8f6-4401-aba3-6eb07797ff93 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129632024-11-18T21:13:11.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9875dc0-8f0f-48c8-a4d6-a61f40c68812 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129642024-11-18T21:13:11.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9875dc0-8f0f-48c8-a4d6-a61f40c68812 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129652024-11-18T21:13:11.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a9875dc0-8f0f-48c8-a4d6-a61f40c68812 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129662024-11-18T21:13:12.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d981010-527a-44a2-a710-36939785e394 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129672024-11-18T21:13:12.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d981010-527a-44a2-a710-36939785e394 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129682024-11-18T21:13:12.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d981010-527a-44a2-a710-36939785e394 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129692024-11-18T21:13:13.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f3ab0e7-b87b-48a6-9a35-76038a9d4959 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129702024-11-18T21:13:13.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f3ab0e7-b87b-48a6-9a35-76038a9d4959 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129712024-11-18T21:13:13.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9f3ab0e7-b87b-48a6-9a35-76038a9d4959 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129722024-11-18T21:13:14.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fb14984-9a3b-4502-b2c3-8c02381a036f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129732024-11-18T21:13:14.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fb14984-9a3b-4502-b2c3-8c02381a036f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129742024-11-18T21:13:14.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2fb14984-9a3b-4502-b2c3-8c02381a036f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129752024-11-18T21:13:15.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e3cb9a4a-2a2e-4a94-b351-60dc31213593 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129762024-11-18T21:13:15.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e3cb9a4a-2a2e-4a94-b351-60dc31213593 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129772024-11-18T21:13:15.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e3cb9a4a-2a2e-4a94-b351-60dc31213593 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
129782024-11-18T21:13:16.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
129792024-11-18T21:13:16.244ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
129802024-11-18T21:13:16.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129812024-11-18T21:13:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129822024-11-18T21:13:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129832024-11-18T21:13:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129842024-11-18T21:13:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129852024-11-18T21:13:16.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129862024-11-18T21:13:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129872024-11-18T21:13:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.165651ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129882024-11-18T21:13:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129892024-11-18T21:13:16.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129902024-11-18T21:13:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129912024-11-18T21:13:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129922024-11-18T21:13:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129932024-11-18T21:13:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129942024-11-18T21:13:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
129952024-11-18T21:13:16.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129962024-11-18T21:13:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129972024-11-18T21:13:16.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
129982024-11-18T21:13:16.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.001595ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
129992024-11-18T21:13:16.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb517f7a-ae53-4c9e-97e5-028cb867876c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130002024-11-18T21:13:16.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb517f7a-ae53-4c9e-97e5-028cb867876c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130012024-11-18T21:13:16.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bb517f7a-ae53-4c9e-97e5-028cb867876c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130022024-11-18T21:13:17.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1afea62b-8ddb-4c41-a64b-5c43978264fe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130032024-11-18T21:13:17.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1afea62b-8ddb-4c41-a64b-5c43978264fe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130042024-11-18T21:13:17.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1afea62b-8ddb-4c41-a64b-5c43978264fe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130052024-11-18T21:13:18.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2a23b32-2fa3-45e1-8eab-05f325fce2df roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130062024-11-18T21:13:18.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2a23b32-2fa3-45e1-8eab-05f325fce2df resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130072024-11-18T21:13:18.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d2a23b32-2fa3-45e1-8eab-05f325fce2df response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130082024-11-18T21:13:19.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f28ca21-432f-41bd-a24f-e9290dcdd7e9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130092024-11-18T21:13:19.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f28ca21-432f-41bd-a24f-e9290dcdd7e9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130102024-11-18T21:13:19.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8f28ca21-432f-41bd-a24f-e9290dcdd7e9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130112024-11-18T21:13:20.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22f55d6f-f282-4f80-a30e-70b5b976e43f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130122024-11-18T21:13:20.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22f55d6f-f282-4f80-a30e-70b5b976e43f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130132024-11-18T21:13:20.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 22f55d6f-f282-4f80-a30e-70b5b976e43f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130142024-11-18T21:13:20.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 479 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 00d21848-8413-4e65-839a-6bd76f529b9c response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
130152024-11-18T21:13:21.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13fcbb50-4ba0-4b27-8448-5950f9e2e198 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130162024-11-18T21:13:21.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13fcbb50-4ba0-4b27-8448-5950f9e2e198 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130172024-11-18T21:13:21.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13fcbb50-4ba0-4b27-8448-5950f9e2e198 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130182024-11-18T21:13:22.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c192572-427d-4191-896b-af0e25d0f192 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130192024-11-18T21:13:22.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c192572-427d-4191-896b-af0e25d0f192 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130202024-11-18T21:13:22.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6c192572-427d-4191-896b-af0e25d0f192 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130212024-11-18T21:13:23.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cf5ac8fd-68d7-4f22-9a2c-f3c356321332 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130222024-11-18T21:13:23.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cf5ac8fd-68d7-4f22-9a2c-f3c356321332 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130232024-11-18T21:13:23.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = cf5ac8fd-68d7-4f22-9a2c-f3c356321332 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130242024-11-18T21:13:24.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53c0bba-ede5-4cab-a2a8-0d79ed62a153 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130252024-11-18T21:13:24.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53c0bba-ede5-4cab-a2a8-0d79ed62a153 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130262024-11-18T21:13:24.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a53c0bba-ede5-4cab-a2a8-0d79ed62a153 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130272024-11-18T21:13:25.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 072f9290-626c-4383-a0a1-5bc1e5bb45e8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130282024-11-18T21:13:25.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 072f9290-626c-4383-a0a1-5bc1e5bb45e8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130292024-11-18T21:13:25.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 072f9290-626c-4383-a0a1-5bc1e5bb45e8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130302024-11-18T21:13:26.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
130312024-11-18T21:13:26.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130322024-11-18T21:13:26.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
130332024-11-18T21:13:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130342024-11-18T21:13:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130352024-11-18T21:13:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130362024-11-18T21:13:26.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130372024-11-18T21:13:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130382024-11-18T21:13:26.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130392024-11-18T21:13:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130402024-11-18T21:13:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130412024-11-18T21:13:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130422024-11-18T21:13:26.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130432024-11-18T21:13:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130442024-11-18T21:13:26.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130452024-11-18T21:13:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
130462024-11-18T21:13:26.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130472024-11-18T21:13:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130482024-11-18T21:13:26.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
130492024-11-18T21:13:26.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.722097ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
130502024-11-18T21:13:26.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.471447ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130512024-11-18T21:13:26.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 156f5e0b-d646-4d67-abbe-aa56dad6a40f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130522024-11-18T21:13:26.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 156f5e0b-d646-4d67-abbe-aa56dad6a40f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130532024-11-18T21:13:26.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 156f5e0b-d646-4d67-abbe-aa56dad6a40f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130542024-11-18T21:13:27.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2456fee5-586a-4f2c-a22a-e25a9ba4614f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130552024-11-18T21:13:27.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2456fee5-586a-4f2c-a22a-e25a9ba4614f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130562024-11-18T21:13:27.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2456fee5-586a-4f2c-a22a-e25a9ba4614f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130572024-11-18T21:13:28.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01f49af1-ada4-4e84-8752-1fb74779d749 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130582024-11-18T21:13:28.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01f49af1-ada4-4e84-8752-1fb74779d749 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130592024-11-18T21:13:28.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 01f49af1-ada4-4e84-8752-1fb74779d749 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130602024-11-18T21:13:29.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ba98644-59df-4f11-97b7-db99553256e1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130612024-11-18T21:13:29.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ba98644-59df-4f11-97b7-db99553256e1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130622024-11-18T21:13:29.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2ba98644-59df-4f11-97b7-db99553256e1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130632024-11-18T21:13:30.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d1f5ef0-b268-4e34-9c70-8dc3f717bc12 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130642024-11-18T21:13:30.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d1f5ef0-b268-4e34-9c70-8dc3f717bc12 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130652024-11-18T21:13:30.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0d1f5ef0-b268-4e34-9c70-8dc3f717bc12 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130662024-11-18T21:13:31.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69bef847-88e6-4f77-8ea0-875ee4d803be roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130672024-11-18T21:13:31.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69bef847-88e6-4f77-8ea0-875ee4d803be resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130682024-11-18T21:13:31.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 69bef847-88e6-4f77-8ea0-875ee4d803be response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130692024-11-18T21:13:32.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f8a56dc0-c3ee-41cc-a09c-46ec751f3175 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130702024-11-18T21:13:32.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f8a56dc0-c3ee-41cc-a09c-46ec751f3175 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130712024-11-18T21:13:32.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f8a56dc0-c3ee-41cc-a09c-46ec751f3175 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130722024-11-18T21:13:33.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dd8f6b-1b72-4fc3-b68e-07aa4dc59dde roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130732024-11-18T21:13:33.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dd8f6b-1b72-4fc3-b68e-07aa4dc59dde resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130742024-11-18T21:13:33.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 61dd8f6b-1b72-4fc3-b68e-07aa4dc59dde response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130752024-11-18T21:13:34.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31711cdc-a2bd-4d37-ab32-6a0b102e1a76 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130762024-11-18T21:13:34.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31711cdc-a2bd-4d37-ab32-6a0b102e1a76 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130772024-11-18T21:13:34.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 31711cdc-a2bd-4d37-ab32-6a0b102e1a76 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130782024-11-18T21:13:35.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 037b6d94-ea20-43f5-b1f1-f85c8e1c4e66 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130792024-11-18T21:13:35.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 037b6d94-ea20-43f5-b1f1-f85c8e1c4e66 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130802024-11-18T21:13:35.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 037b6d94-ea20-43f5-b1f1-f85c8e1c4e66 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
130812024-11-18T21:13:35.879ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 653455d6-466f-43c5-8f08-6ffd91c62414 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
130822024-11-18T21:13:36.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
130832024-11-18T21:13:36.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
130842024-11-18T21:13:36.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130852024-11-18T21:13:36.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
130862024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130872024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
130882024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
130892024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
130902024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
130912024-11-18T21:13:36.245ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
130922024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130932024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130942024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130952024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
130962024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
130972024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130982024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130992024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
131002024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
131012024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131022024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131032024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
131042024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
131052024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
131062024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
131072024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
131082024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
131092024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
131102024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
131112024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131122024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
131132024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
131142024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
131152024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131162024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
131172024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
131182024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131192024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131202024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131212024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131222024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131232024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131242024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
131252024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131262024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131272024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
131282024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
131292024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131302024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131312024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
131322024-11-18T21:13:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
131332024-11-18T21:13:36.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 556861238 } })
131342024-11-18T21:13:36.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
131352024-11-18T21:13:36.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 557796485 } })
131362024-11-18T21:13:36.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131372024-11-18T21:13:36.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
131382024-11-18T21:13:36.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131392024-11-18T21:13:36.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131402024-11-18T21:13:36.250ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.823656ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
131412024-11-18T21:13:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
131422024-11-18T21:13:36.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131432024-11-18T21:13:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131442024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
131452024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131462024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131472024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
131482024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131492024-11-18T21:13:36.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131502024-11-18T21:13:36.257ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131512024-11-18T21:13:36.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131522024-11-18T21:13:36.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131532024-11-18T21:13:36.260ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131542024-11-18T21:13:36.260ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
131552024-11-18T21:13:36.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131562024-11-18T21:13:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131572024-11-18T21:13:36.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1725, tv_nsec: 572306573 } })
131582024-11-18T21:13:36.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131592024-11-18T21:13:36.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
131602024-11-18T21:13:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131612024-11-18T21:13:36.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131622024-11-18T21:13:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131632024-11-18T21:13:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131642024-11-18T21:13:36.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131652024-11-18T21:13:36.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131662024-11-18T21:13:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131672024-11-18T21:13:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
131682024-11-18T21:13:36.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131692024-11-18T21:13:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131702024-11-18T21:13:36.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131712024-11-18T21:13:36.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
131722024-11-18T21:13:36.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131732024-11-18T21:13:36.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131742024-11-18T21:13:36.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131752024-11-18T21:13:36.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131762024-11-18T21:13:36.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131772024-11-18T21:13:36.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131782024-11-18T21:13:36.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
131792024-11-18T21:13:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
131802024-11-18T21:13:36.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131812024-11-18T21:13:36.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131822024-11-18T21:13:36.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131832024-11-18T21:13:36.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131842024-11-18T21:13:36.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131852024-11-18T21:13:36.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
131862024-11-18T21:13:36.298ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
131872024-11-18T21:13:36.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
131882024-11-18T21:13:36.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.478239ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
131892024-11-18T21:13:36.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
131902024-11-18T21:13:36.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
131912024-11-18T21:13:36.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
131922024-11-18T21:13:36.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.867799ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
131932024-11-18T21:13:36.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.106ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
131942024-11-18T21:13:36.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.315437ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
131952024-11-18T21:13:36.305ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131962024-11-18T21:13:36.305ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
131972024-11-18T21:13:36.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131982024-11-18T21:13:36.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131992024-11-18T21:13:36.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132002024-11-18T21:13:36.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.431661ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132012024-11-18T21:13:36.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132022024-11-18T21:13:36.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132032024-11-18T21:13:36.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132042024-11-18T21:13:36.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132052024-11-18T21:13:36.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132062024-11-18T21:13:36.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132072024-11-18T21:13:36.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132082024-11-18T21:13:36.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132092024-11-18T21:13:36.327ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132102024-11-18T21:13:36.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132112024-11-18T21:13:36.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
132122024-11-18T21:13:36.329ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
132132024-11-18T21:13:36.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.980653ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
132142024-11-18T21:13:36.330ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bfb02bd-fd9f-4cb8-9dd3-09941016857e", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:36 GMT"} })
132152024-11-18T21:13:36.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132162024-11-18T21:13:36.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
132172024-11-18T21:13:36.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132182024-11-18T21:13:36.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132192024-11-18T21:13:36.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
132202024-11-18T21:13:36.332ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
132212024-11-18T21:13:36.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.240971ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
132222024-11-18T21:13:36.332ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.561463ms iteration = 26 status = 0
132232024-11-18T21:13:36.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
132242024-11-18T21:13:36.333ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
132252024-11-18T21:13:36.333ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "831fb560-bce1-4c34-bc23-faa8e435f124", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:36 GMT"} })
132262024-11-18T21:13:36.333ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132272024-11-18T21:13:36.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
132282024-11-18T21:13:36.336ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132292024-11-18T21:13:36.336ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
132302024-11-18T21:13:36.336ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.846118ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
132312024-11-18T21:13:36.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
132322024-11-18T21:13:36.353ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
132332024-11-18T21:13:36.353ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "112b6ce7-873e-47f2-9ce2-33351e2d428b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:13:36 GMT"} })
132342024-11-18T21:13:36.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132352024-11-18T21:13:36.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
132362024-11-18T21:13:36.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.254352ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
132372024-11-18T21:13:36.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132382024-11-18T21:13:36.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132392024-11-18T21:13:36.386ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.663117ms iteration = 29 status = {"physical_disks_added":0}
132402024-11-18T21:13:36.418ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
132412024-11-18T21:13:36.419ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfdb4f69-de29-437c-92e4-d4d672d682de", "content-length": "2", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132422024-11-18T21:13:36.420ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132432024-11-18T21:13:36.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132442024-11-18T21:13:36.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132452024-11-18T21:13:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132462024-11-18T21:13:36.517ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.069667ms iteration = 26 status = {}
132472024-11-18T21:13:36.525ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
132482024-11-18T21:13:36.525ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132492024-11-18T21:13:36.525ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6a8052-aff8-4530-a43d-02e08a5fc013", "content-length": "372", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132502024-11-18T21:13:36.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132512024-11-18T21:13:36.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132522024-11-18T21:13:36.526ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.454546ms iteration = 26 status = null
132532024-11-18T21:13:36.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132542024-11-18T21:13:36.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
132552024-11-18T21:13:36.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132562024-11-18T21:13:36.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132572024-11-18T21:13:36.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132582024-11-18T21:13:36.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
132592024-11-18T21:13:36.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132602024-11-18T21:13:36.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132612024-11-18T21:13:36.540ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
132622024-11-18T21:13:36.541ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
132632024-11-18T21:13:36.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49f797b1-86d0-4fe2-b6ca-b3e19b68a588", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132642024-11-18T21:13:36.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132652024-11-18T21:13:36.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132662024-11-18T21:13:36.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132672024-11-18T21:13:36.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132682024-11-18T21:13:36.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132692024-11-18T21:13:36.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132702024-11-18T21:13:36.550ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132712024-11-18T21:13:36.550ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132722024-11-18T21:13:36.550ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c1b30e95-59d3-424f-8f7e-3d592452081e", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132732024-11-18T21:13:36.551ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.719648ms iteration = 27 status = {}
132742024-11-18T21:13:36.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132752024-11-18T21:13:36.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132762024-11-18T21:13:36.559ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
132772024-11-18T21:13:36.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132782024-11-18T21:13:36.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132792024-11-18T21:13:36.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
132802024-11-18T21:13:36.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba61fee2-5165-4f39-a7c4-6b76adc1faf1", "content-length": "134", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132812024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
132822024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
132832024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
132842024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
132852024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132862024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132872024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132882024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132892024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132902024-11-18T21:13:36.568ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132912024-11-18T21:13:36.569ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
132922024-11-18T21:13:36.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132932024-11-18T21:13:36.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132942024-11-18T21:13:36.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
132952024-11-18T21:13:36.570ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5caabb46-d2dd-4f7f-98b5-8792fcc1a6a1", "content-length": "2", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132962024-11-18T21:13:36.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
132972024-11-18T21:13:36.570ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "58c1abbc-4689-4c70-8f46-f9d80d2f74d9", "content-length": "51", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
132982024-11-18T21:13:36.570ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
132992024-11-18T21:13:36.570ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
133002024-11-18T21:13:36.616ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
133012024-11-18T21:13:36.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2b98a38-d081-48de-82e9-a52a758882c3", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
133022024-11-18T21:13:36.669ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
133032024-11-18T21:13:36.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
133042024-11-18T21:13:36.669ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2c9eef3-7c4f-43f5-bb86-7f98b6ade332", "content-length": "691", "date": "Mon, 18 Nov 2024 21:13:35 GMT"} })
133052024-11-18T21:13:36.669ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
133062024-11-18T21:13:36.669ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
133072024-11-18T21:13:36.669ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
133082024-11-18T21:13:36.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "767c81b9-ab34-4063-a417-faf862e33114", "content-length": "682", "date": "Mon, 18 Nov 2024 21:13:36 GMT"} })
133092024-11-18T21:13:36.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133102024-11-18T21:13:36.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133112024-11-18T21:13:36.670ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.494603ms iteration = 27 status = {}
133122024-11-18T21:13:36.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133132024-11-18T21:13:36.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133142024-11-18T21:13:36.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133152024-11-18T21:13:36.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133162024-11-18T21:13:36.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133172024-11-18T21:13:36.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133182024-11-18T21:13:36.687ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 441.980777ms iteration = 26 status = {}
133192024-11-18T21:13:36.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e32fb59f-5db4-4c90-9f5d-fd96fdc86cf4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133202024-11-18T21:13:36.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e32fb59f-5db4-4c90-9f5d-fd96fdc86cf4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133212024-11-18T21:13:36.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e32fb59f-5db4-4c90-9f5d-fd96fdc86cf4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133222024-11-18T21:13:37.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a1c9eef-88dc-4343-b1a6-a2433b62ba01 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133232024-11-18T21:13:37.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a1c9eef-88dc-4343-b1a6-a2433b62ba01 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133242024-11-18T21:13:37.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4a1c9eef-88dc-4343-b1a6-a2433b62ba01 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133252024-11-18T21:13:38.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1415148-d976-436c-b43d-ef37af6be191 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133262024-11-18T21:13:38.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1415148-d976-436c-b43d-ef37af6be191 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133272024-11-18T21:13:38.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a1415148-d976-436c-b43d-ef37af6be191 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133282024-11-18T21:13:39.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b510b52-fbaf-416a-955c-7b95f02e90d2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133292024-11-18T21:13:39.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b510b52-fbaf-416a-955c-7b95f02e90d2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133302024-11-18T21:13:39.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8b510b52-fbaf-416a-955c-7b95f02e90d2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133312024-11-18T21:13:40.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = c915580d-8c25-4b5c-a65e-c4b23e0a8556 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
133322024-11-18T21:13:40.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = c915580d-8c25-4b5c-a65e-c4b23e0a8556 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
133332024-11-18T21:13:40.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = c915580d-8c25-4b5c-a65e-c4b23e0a8556 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
133342024-11-18T21:13:40.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 79cfd558-a043-4f61-b05d-5b9aab9e8851 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
133352024-11-18T21:13:40.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 79cfd558-a043-4f61-b05d-5b9aab9e8851 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
133362024-11-18T21:13:40.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 79cfd558-a043-4f61-b05d-5b9aab9e8851 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
133372024-11-18T21:13:40.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 280704f4-590a-44f3-aacd-04abb23a16d2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133382024-11-18T21:13:40.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 280704f4-590a-44f3-aacd-04abb23a16d2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133392024-11-18T21:13:40.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 280704f4-590a-44f3-aacd-04abb23a16d2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133402024-11-18T21:13:41.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33f53128-282f-48e5-9bcb-e97a6bd226b8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133412024-11-18T21:13:41.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33f53128-282f-48e5-9bcb-e97a6bd226b8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133422024-11-18T21:13:41.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 33f53128-282f-48e5-9bcb-e97a6bd226b8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133432024-11-18T21:13:42.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeeed8da-b7b4-4f2c-980a-9b726238e2f1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133442024-11-18T21:13:42.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeeed8da-b7b4-4f2c-980a-9b726238e2f1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133452024-11-18T21:13:42.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = aeeed8da-b7b4-4f2c-980a-9b726238e2f1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133462024-11-18T21:13:44.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88286a49-9b4d-49a6-ad49-83bce846a83f roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133472024-11-18T21:13:44.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88286a49-9b4d-49a6-ad49-83bce846a83f resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133482024-11-18T21:13:44.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 88286a49-9b4d-49a6-ad49-83bce846a83f response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133492024-11-18T21:13:45.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19367671-77b4-43ca-967f-f6c828bd0ac9 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133502024-11-18T21:13:45.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19367671-77b4-43ca-967f-f6c828bd0ac9 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133512024-11-18T21:13:45.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 19367671-77b4-43ca-967f-f6c828bd0ac9 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133522024-11-18T21:13:46.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83d0e87c-5176-4e4d-8654-22f28d6bc44a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133532024-11-18T21:13:46.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83d0e87c-5176-4e4d-8654-22f28d6bc44a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133542024-11-18T21:13:46.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83d0e87c-5176-4e4d-8654-22f28d6bc44a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133552024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
133562024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
133572024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133582024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133592024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133602024-11-18T21:13:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133612024-11-18T21:13:46.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133622024-11-18T21:13:46.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133632024-11-18T21:13:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133642024-11-18T21:13:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.0435ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133652024-11-18T21:13:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133662024-11-18T21:13:46.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133672024-11-18T21:13:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133682024-11-18T21:13:46.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133692024-11-18T21:13:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133702024-11-18T21:13:46.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133712024-11-18T21:13:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
133722024-11-18T21:13:46.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133732024-11-18T21:13:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133742024-11-18T21:13:46.268ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
133752024-11-18T21:13:46.268ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.451285ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
133762024-11-18T21:13:47.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b007454c-15c5-4537-8395-62f941f740d4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133772024-11-18T21:13:47.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b007454c-15c5-4537-8395-62f941f740d4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133782024-11-18T21:13:47.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b007454c-15c5-4537-8395-62f941f740d4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133792024-11-18T21:13:48.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97f9246b-a3ca-4a08-959d-e1bfda92debe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133802024-11-18T21:13:48.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97f9246b-a3ca-4a08-959d-e1bfda92debe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133812024-11-18T21:13:48.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 97f9246b-a3ca-4a08-959d-e1bfda92debe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133822024-11-18T21:13:49.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c3ef5759-ce2b-4259-a70b-c349284f848b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133832024-11-18T21:13:49.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c3ef5759-ce2b-4259-a70b-c349284f848b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133842024-11-18T21:13:49.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c3ef5759-ce2b-4259-a70b-c349284f848b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133852024-11-18T21:13:50.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09c529c6-9641-428a-aa38-76e7c604682e roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133862024-11-18T21:13:50.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09c529c6-9641-428a-aa38-76e7c604682e resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133872024-11-18T21:13:50.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 09c529c6-9641-428a-aa38-76e7c604682e response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133882024-11-18T21:13:50.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 6e94a910-bd23-4f80-93e4-e4b443aa21fe response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
133892024-11-18T21:13:51.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e406062f-4233-4e80-976f-c70126d727ea roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133902024-11-18T21:13:51.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e406062f-4233-4e80-976f-c70126d727ea resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133912024-11-18T21:13:51.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e406062f-4233-4e80-976f-c70126d727ea response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133922024-11-18T21:13:52.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bf3fd36b-4bb2-49e8-b878-0d677364c5be roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133932024-11-18T21:13:52.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bf3fd36b-4bb2-49e8-b878-0d677364c5be resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133942024-11-18T21:13:52.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = bf3fd36b-4bb2-49e8-b878-0d677364c5be response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133952024-11-18T21:13:53.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32722526-c6b7-41be-a3a9-6b2efefb20f4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133962024-11-18T21:13:53.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32722526-c6b7-41be-a3a9-6b2efefb20f4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133972024-11-18T21:13:53.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32722526-c6b7-41be-a3a9-6b2efefb20f4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133982024-11-18T21:13:54.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed1d273a-34b3-4da9-af7d-be0c8e39f8b3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
133992024-11-18T21:13:54.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed1d273a-34b3-4da9-af7d-be0c8e39f8b3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134002024-11-18T21:13:54.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ed1d273a-34b3-4da9-af7d-be0c8e39f8b3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134012024-11-18T21:13:55.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32d885c8-ca28-44b9-b069-d310bcc3ec8b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134022024-11-18T21:13:55.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32d885c8-ca28-44b9-b069-d310bcc3ec8b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134032024-11-18T21:13:55.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 32d885c8-ca28-44b9-b069-d310bcc3ec8b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134042024-11-18T21:13:56.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
134052024-11-18T21:13:56.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
134062024-11-18T21:13:56.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134072024-11-18T21:13:56.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134082024-11-18T21:13:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134092024-11-18T21:13:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134102024-11-18T21:13:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134112024-11-18T21:13:56.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134122024-11-18T21:13:56.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134132024-11-18T21:13:56.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.130021ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134142024-11-18T21:13:56.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134152024-11-18T21:13:56.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134162024-11-18T21:13:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134172024-11-18T21:13:56.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134182024-11-18T21:13:56.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134192024-11-18T21:13:56.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134202024-11-18T21:13:56.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
134212024-11-18T21:13:56.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134222024-11-18T21:13:56.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134232024-11-18T21:13:56.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
134242024-11-18T21:13:56.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.506615ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
134252024-11-18T21:13:56.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2d95119-6038-4b25-ab0b-826cb304f809 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134262024-11-18T21:13:56.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2d95119-6038-4b25-ab0b-826cb304f809 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134272024-11-18T21:13:56.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f2d95119-6038-4b25-ab0b-826cb304f809 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134282024-11-18T21:13:57.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fddcb40f-98e3-44ae-ae46-4520bf62b85a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134292024-11-18T21:13:57.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fddcb40f-98e3-44ae-ae46-4520bf62b85a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134302024-11-18T21:13:57.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fddcb40f-98e3-44ae-ae46-4520bf62b85a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134312024-11-18T21:13:58.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ffb7ce5-55a8-46f6-a17e-fde9c6152135 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134322024-11-18T21:13:58.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ffb7ce5-55a8-46f6-a17e-fde9c6152135 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134332024-11-18T21:13:58.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9ffb7ce5-55a8-46f6-a17e-fde9c6152135 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134342024-11-18T21:13:59.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c165ddef-e2d7-4c48-9979-12c879cc11e8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134352024-11-18T21:13:59.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c165ddef-e2d7-4c48-9979-12c879cc11e8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134362024-11-18T21:13:59.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c165ddef-e2d7-4c48-9979-12c879cc11e8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134372024-11-18T21:14:00.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f29c3fc-d7d5-4c5d-8031-0ab142270693 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134382024-11-18T21:14:00.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f29c3fc-d7d5-4c5d-8031-0ab142270693 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134392024-11-18T21:14:00.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3f29c3fc-d7d5-4c5d-8031-0ab142270693 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134402024-11-18T21:14:01.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e6815c-b2ce-47fb-9d12-0c699b93f93b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134412024-11-18T21:14:01.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e6815c-b2ce-47fb-9d12-0c699b93f93b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134422024-11-18T21:14:01.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 89e6815c-b2ce-47fb-9d12-0c699b93f93b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134432024-11-18T21:14:02.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c993cce-52e9-462c-980e-93393284bf3d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134442024-11-18T21:14:02.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c993cce-52e9-462c-980e-93393284bf3d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134452024-11-18T21:14:02.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c993cce-52e9-462c-980e-93393284bf3d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134462024-11-18T21:14:03.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83bbd814-9ea1-40c8-9585-594ad9633982 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134472024-11-18T21:14:03.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83bbd814-9ea1-40c8-9585-594ad9633982 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134482024-11-18T21:14:03.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 83bbd814-9ea1-40c8-9585-594ad9633982 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134492024-11-18T21:14:04.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ee13245-7ccd-4baf-bd4b-51ada77f1f46 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134502024-11-18T21:14:04.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ee13245-7ccd-4baf-bd4b-51ada77f1f46 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134512024-11-18T21:14:04.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8ee13245-7ccd-4baf-bd4b-51ada77f1f46 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134522024-11-18T21:14:05.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d28fae8d-8816-46b5-90f1-75da43e91daf roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134532024-11-18T21:14:05.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d28fae8d-8816-46b5-90f1-75da43e91daf resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134542024-11-18T21:14:05.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = d28fae8d-8816-46b5-90f1-75da43e91daf response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
134552024-11-18T21:14:05.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = d5e4db3e-ab75-45ed-a4b9-f2723dca519b response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
134562024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
134572024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134582024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
134592024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
134602024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
134612024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
134622024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134632024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
134642024-11-18T21:14:06.244ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:04:06.244490308 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
134652024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
134662024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
134672024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
134682024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
134692024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134702024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
134712024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134722024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
134732024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
134742024-11-18T21:14:06.244ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
134752024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
134762024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134772024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134782024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
134792024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134802024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134812024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
134822024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
134832024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134842024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
134852024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134862024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134872024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
134882024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134892024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
134902024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
134912024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
134922024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134932024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134942024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
134952024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134962024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
134972024-11-18T21:14:06.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
134982024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
134992024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.73\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
135002024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135012024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
135022024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
135032024-11-18T21:14:06.245ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
135042024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135052024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135062024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
135072024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135082024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
135092024-11-18T21:14:06.245ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
135102024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135112024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
135122024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
135132024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
135142024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
135152024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
135162024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
135172024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
135182024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
135192024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
135202024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
135212024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
135222024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
135232024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135242024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135252024-11-18T21:14:06.245ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 554674052 } })
135262024-11-18T21:14:06.245ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 554674502 } })
135272024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135282024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135292024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135302024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
135312024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135322024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
135332024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135342024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135352024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135362024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135372024-11-18T21:14:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
135382024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
135392024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
135402024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
135412024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
135422024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
135432024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
135442024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
135452024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.746483ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
135462024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
135472024-11-18T21:14:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.792033ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
135482024-11-18T21:14:06.248ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:04:06.244490308 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
135492024-11-18T21:14:06.248ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.694707ms iteration = 14 status = {"expiration":"2024-11-18T21:04:06.244490308Z","pruned":[]}
135502024-11-18T21:14:06.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135512024-11-18T21:14:06.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135522024-11-18T21:14:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135532024-11-18T21:14:06.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135542024-11-18T21:14:06.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 559056194 } })
135552024-11-18T21:14:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135562024-11-18T21:14:06.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
135572024-11-18T21:14:06.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 559762380 } })
135582024-11-18T21:14:06.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
135592024-11-18T21:14:06.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135602024-11-18T21:14:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
135612024-11-18T21:14:06.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
135622024-11-18T21:14:06.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135632024-11-18T21:14:06.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135642024-11-18T21:14:06.254ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.793856ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
135652024-11-18T21:14:06.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135662024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135672024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135682024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
135692024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135702024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135712024-11-18T21:14:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135722024-11-18T21:14:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
135732024-11-18T21:14:06.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135742024-11-18T21:14:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135752024-11-18T21:14:06.258ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135762024-11-18T21:14:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135772024-11-18T21:14:06.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135782024-11-18T21:14:06.260ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135792024-11-18T21:14:06.261ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.780837ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
135802024-11-18T21:14:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
135812024-11-18T21:14:06.262ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135822024-11-18T21:14:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
135832024-11-18T21:14:06.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
135842024-11-18T21:14:06.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135852024-11-18T21:14:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135862024-11-18T21:14:06.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135872024-11-18T21:14:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
135882024-11-18T21:14:06.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135892024-11-18T21:14:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
135902024-11-18T21:14:06.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.628759ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
135912024-11-18T21:14:06.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135922024-11-18T21:14:06.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135932024-11-18T21:14:06.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135942024-11-18T21:14:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135952024-11-18T21:14:06.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
135962024-11-18T21:14:06.276ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1755, tv_nsec: 585083359 } })
135972024-11-18T21:14:06.276ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
135982024-11-18T21:14:06.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.250723ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135992024-11-18T21:14:06.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136002024-11-18T21:14:06.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136012024-11-18T21:14:06.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
136022024-11-18T21:14:06.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136032024-11-18T21:14:06.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136042024-11-18T21:14:06.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136052024-11-18T21:14:06.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136062024-11-18T21:14:06.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136072024-11-18T21:14:06.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
136082024-11-18T21:14:06.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136092024-11-18T21:14:06.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136102024-11-18T21:14:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
136112024-11-18T21:14:06.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136122024-11-18T21:14:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136132024-11-18T21:14:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
136142024-11-18T21:14:06.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136152024-11-18T21:14:06.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136162024-11-18T21:14:06.286ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
136172024-11-18T21:14:06.286ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.227907ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
136182024-11-18T21:14:06.299ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
136192024-11-18T21:14:06.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
136202024-11-18T21:14:06.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
136212024-11-18T21:14:06.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
136222024-11-18T21:14:06.305ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136232024-11-18T21:14:06.305ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
136242024-11-18T21:14:06.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136252024-11-18T21:14:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136262024-11-18T21:14:06.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136272024-11-18T21:14:06.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136282024-11-18T21:14:06.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136292024-11-18T21:14:06.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136302024-11-18T21:14:06.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136312024-11-18T21:14:06.312ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
136322024-11-18T21:14:06.312ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.717695ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
136332024-11-18T21:14:06.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 68.831013ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
136342024-11-18T21:14:06.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136352024-11-18T21:14:06.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136362024-11-18T21:14:06.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136372024-11-18T21:14:06.321ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
136382024-11-18T21:14:06.321ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
136392024-11-18T21:14:06.321ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.571144ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
136402024-11-18T21:14:06.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136412024-11-18T21:14:06.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136422024-11-18T21:14:06.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136432024-11-18T21:14:06.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136442024-11-18T21:14:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136452024-11-18T21:14:06.327ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
136462024-11-18T21:14:06.327ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
136472024-11-18T21:14:06.327ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.373014ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
136482024-11-18T21:14:06.328ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.006759ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
136492024-11-18T21:14:06.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
136502024-11-18T21:14:06.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136512024-11-18T21:14:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136522024-11-18T21:14:06.329ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
136532024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
136542024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
136552024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136562024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136572024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
136582024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
136592024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
136602024-11-18T21:14:06.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136612024-11-18T21:14:06.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136622024-11-18T21:14:06.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136632024-11-18T21:14:06.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136642024-11-18T21:14:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136652024-11-18T21:14:06.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136662024-11-18T21:14:06.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136672024-11-18T21:14:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
136682024-11-18T21:14:06.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136692024-11-18T21:14:06.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136702024-11-18T21:14:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
136712024-11-18T21:14:06.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136722024-11-18T21:14:06.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136732024-11-18T21:14:06.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
136742024-11-18T21:14:06.338ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136752024-11-18T21:14:06.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136762024-11-18T21:14:06.339ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
136772024-11-18T21:14:06.339ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
136782024-11-18T21:14:06.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136792024-11-18T21:14:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136802024-11-18T21:14:06.340ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.137879ms iteration = 27 status = 0
136812024-11-18T21:14:06.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136822024-11-18T21:14:06.343ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.383463ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
136832024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
136842024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136852024-11-18T21:14:06.344ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136862024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
136872024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136882024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136892024-11-18T21:14:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136902024-11-18T21:14:06.346ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.083294ms iteration = 30 status = {"physical_disks_added":0}
136912024-11-18T21:14:06.347ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
136922024-11-18T21:14:06.347ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
136932024-11-18T21:14:06.347ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
136942024-11-18T21:14:06.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 103.109549ms iteration = 14 status = {"generation":1}
136952024-11-18T21:14:06.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136962024-11-18T21:14:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136972024-11-18T21:14:06.352ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136982024-11-18T21:14:06.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.175454ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
136992024-11-18T21:14:06.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
137002024-11-18T21:14:06.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137012024-11-18T21:14:06.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137022024-11-18T21:14:06.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
137032024-11-18T21:14:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
137042024-11-18T21:14:06.378ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
137052024-11-18T21:14:06.378ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
137062024-11-18T21:14:06.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137072024-11-18T21:14:06.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137082024-11-18T21:14:06.380ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137092024-11-18T21:14:06.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137102024-11-18T21:14:06.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137112024-11-18T21:14:06.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137122024-11-18T21:14:06.385ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
137132024-11-18T21:14:06.385ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
137142024-11-18T21:14:06.385ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
137152024-11-18T21:14:06.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 140.850031ms iteration = 14 status = {"generation":2}
137162024-11-18T21:14:06.389ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137172024-11-18T21:14:06.389ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
137182024-11-18T21:14:06.389ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.039934ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
137192024-11-18T21:14:06.393ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
137202024-11-18T21:14:06.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137212024-11-18T21:14:06.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137222024-11-18T21:14:06.398ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
137232024-11-18T21:14:06.398ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 153.647336ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
137242024-11-18T21:14:06.405ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
137252024-11-18T21:14:06.405ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137262024-11-18T21:14:06.405ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d843f9e7-5499-4f21-89f6-1d0a7b75306d", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137272024-11-18T21:14:06.405ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137282024-11-18T21:14:06.406ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
137292024-11-18T21:14:06.407ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137302024-11-18T21:14:06.407ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "756fde15-f106-4203-b574-df84f90cbcdc", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137312024-11-18T21:14:06.407ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137322024-11-18T21:14:06.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
137332024-11-18T21:14:06.409ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
137342024-11-18T21:14:06.432ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
137352024-11-18T21:14:06.432ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.356217ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
137362024-11-18T21:14:06.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137372024-11-18T21:14:06.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137382024-11-18T21:14:06.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137392024-11-18T21:14:06.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
137402024-11-18T21:14:06.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137412024-11-18T21:14:06.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137422024-11-18T21:14:06.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
137432024-11-18T21:14:06.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
137442024-11-18T21:14:06.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b5c8d15a-d402-4e68-bd0f-5b3de1331aa3", "date": "Mon, 18 Nov 2024 21:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
137452024-11-18T21:14:06.541ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
137462024-11-18T21:14:06.544ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f958c1b3-8034-40a9-b712-f59fea51eef1", "date": "Mon, 18 Nov 2024 21:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
137472024-11-18T21:14:06.544ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
137482024-11-18T21:14:06.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9fde5e7-94b9-4825-95e4-eab4eee4ecd5 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
137492024-11-18T21:14:06.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9fde5e7-94b9-4825-95e4-eab4eee4ecd5 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
137502024-11-18T21:14:06.545ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
137512024-11-18T21:14:06.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.137156ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
137522024-11-18T21:14:06.577ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
137532024-11-18T21:14:06.577ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca89a0b-12bd-4cbc-b338-23b60c688c03", "content-length": "2", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137542024-11-18T21:14:06.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
137552024-11-18T21:14:06.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
137562024-11-18T21:14:06.579ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 335.318092ms iteration = 27 status = {}
137572024-11-18T21:14:06.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
137582024-11-18T21:14:06.595ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137592024-11-18T21:14:06.595ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d26d09df-ad80-4f5c-9d37-670a2640ce8b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137602024-11-18T21:14:06.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137612024-11-18T21:14:06.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
137622024-11-18T21:14:06.710ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
137632024-11-18T21:14:06.710ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
137642024-11-18T21:14:06.710ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4ce459c-9186-4c1b-917c-2b3ed31b76b6", "content-length": "372", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137652024-11-18T21:14:06.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137662024-11-18T21:14:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137672024-11-18T21:14:06.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
137682024-11-18T21:14:06.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137692024-11-18T21:14:06.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9fde5e7-94b9-4825-95e4-eab4eee4ecd5 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
137702024-11-18T21:14:06.713ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 468.684675ms iteration = 27 status = null
137712024-11-18T21:14:06.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
137722024-11-18T21:14:06.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137732024-11-18T21:14:06.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137742024-11-18T21:14:06.725ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
137752024-11-18T21:14:06.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
137762024-11-18T21:14:06.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7abc6c56-2906-4637-814f-7b9a48fefb36", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137772024-11-18T21:14:06.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137782024-11-18T21:14:06.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137792024-11-18T21:14:06.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137802024-11-18T21:14:06.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137812024-11-18T21:14:06.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137822024-11-18T21:14:06.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137832024-11-18T21:14:06.734ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
137842024-11-18T21:14:06.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
137852024-11-18T21:14:06.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74e60626-d8c8-4e35-8e63-a306eace91ed", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137862024-11-18T21:14:06.736ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 491.354675ms iteration = 28 status = {}
137872024-11-18T21:14:06.777ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
137882024-11-18T21:14:06.777ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0be75e32-e1d3-4d47-b8cd-053e6f3670c5", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137892024-11-18T21:14:06.777ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137902024-11-18T21:14:06.779ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dc6a49df-cbb0-44af-b0bf-796c76767ce1", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137912024-11-18T21:14:06.779ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137922024-11-18T21:14:06.780ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c9eb9992-6e36-4cac-93c6-80385fe5fd42", "date": "Mon, 18 Nov 2024 21:14:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137932024-11-18T21:14:06.780ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137942024-11-18T21:14:06.782ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137952024-11-18T21:14:06.782ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 538.399585ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
137962024-11-18T21:14:06.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
137972024-11-18T21:14:06.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "917a0fce-8336-4705-89a1-fcdccdf52354", "content-length": "691", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
137982024-11-18T21:14:06.792ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
137992024-11-18T21:14:06.792ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
138002024-11-18T21:14:06.792ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
138012024-11-18T21:14:06.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 548.790823ms iteration = 28 status = {}
138022024-11-18T21:14:06.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138032024-11-18T21:14:06.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138042024-11-18T21:14:06.804ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
138052024-11-18T21:14:06.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138062024-11-18T21:14:06.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138072024-11-18T21:14:06.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
138082024-11-18T21:14:06.812ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f53bc2-d6db-4c1f-a3da-f4cf7fc4175d", "content-length": "134", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
138092024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
138102024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
138112024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
138122024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
138132024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138142024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138152024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138162024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
138172024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138182024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
138192024-11-18T21:14:06.812ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
138202024-11-18T21:14:06.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138212024-11-18T21:14:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138222024-11-18T21:14:06.814ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
138232024-11-18T21:14:06.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1085e8-1203-4b17-bba3-a3d0603a45c0", "content-length": "2", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
138242024-11-18T21:14:06.814ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
138252024-11-18T21:14:06.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d5e9bdb-f7ed-4fbc-9136-df81e111f782", "content-length": "51", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
138262024-11-18T21:14:06.814ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
138272024-11-18T21:14:06.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
138282024-11-18T21:14:06.923ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4fbea16b-d366-43a2-a5a4-f2baeb9b845e", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
138292024-11-18T21:14:06.923ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
138302024-11-18T21:14:06.923ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
138312024-11-18T21:14:06.923ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "99348395-dbd7-463c-9758-47d288501d43", "content-length": "682", "date": "Mon, 18 Nov 2024 21:14:06 GMT"} })
138322024-11-18T21:14:06.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138332024-11-18T21:14:06.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138342024-11-18T21:14:06.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138352024-11-18T21:14:06.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138362024-11-18T21:14:06.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138372024-11-18T21:14:06.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138382024-11-18T21:14:06.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138392024-11-18T21:14:06.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138402024-11-18T21:14:06.941ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.477044ms iteration = 27 status = {}
138412024-11-18T21:14:07.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f3e0a250-cb0d-4ffa-9326-30f84218e033 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138422024-11-18T21:14:07.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f3e0a250-cb0d-4ffa-9326-30f84218e033 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138432024-11-18T21:14:07.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f3e0a250-cb0d-4ffa-9326-30f84218e033 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138442024-11-18T21:14:08.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90e291da-0531-43f2-8f50-28bfc8aceb42 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138452024-11-18T21:14:08.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90e291da-0531-43f2-8f50-28bfc8aceb42 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138462024-11-18T21:14:08.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 90e291da-0531-43f2-8f50-28bfc8aceb42 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138472024-11-18T21:14:09.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e49262a4-3961-443b-a614-14fcc8f593ef roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138482024-11-18T21:14:09.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e49262a4-3961-443b-a614-14fcc8f593ef resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138492024-11-18T21:14:09.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e49262a4-3961-443b-a614-14fcc8f593ef response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138502024-11-18T21:14:10.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6934fbe6-6742-47bd-8060-b03a9f718901 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138512024-11-18T21:14:10.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6934fbe6-6742-47bd-8060-b03a9f718901 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138522024-11-18T21:14:10.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6934fbe6-6742-47bd-8060-b03a9f718901 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138532024-11-18T21:14:10.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3c1efde-9ef3-4cb7-9cfc-8060033030e0 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
138542024-11-18T21:14:10.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3c1efde-9ef3-4cb7-9cfc-8060033030e0 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
138552024-11-18T21:14:10.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3c1efde-9ef3-4cb7-9cfc-8060033030e0 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
138562024-11-18T21:14:10.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3e944cb-0330-4f63-9b3b-1b560c6bfad1 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
138572024-11-18T21:14:10.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3e944cb-0330-4f63-9b3b-1b560c6bfad1 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
138582024-11-18T21:14:10.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = b3e944cb-0330-4f63-9b3b-1b560c6bfad1 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
138592024-11-18T21:14:11.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13bede64-8cc3-4b8c-b123-ef196adefaf1 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138602024-11-18T21:14:11.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13bede64-8cc3-4b8c-b123-ef196adefaf1 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138612024-11-18T21:14:11.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13bede64-8cc3-4b8c-b123-ef196adefaf1 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138622024-11-18T21:14:12.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 705f676a-d71c-4f65-8686-824d0d5431d2 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138632024-11-18T21:14:12.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 705f676a-d71c-4f65-8686-824d0d5431d2 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138642024-11-18T21:14:12.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 705f676a-d71c-4f65-8686-824d0d5431d2 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138652024-11-18T21:14:13.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d2fb129-bd4b-46ae-abe4-be4b9ff7c013 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138662024-11-18T21:14:13.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d2fb129-bd4b-46ae-abe4-be4b9ff7c013 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138672024-11-18T21:14:13.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1d2fb129-bd4b-46ae-abe4-be4b9ff7c013 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138682024-11-18T21:14:14.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b4fa7b7a-0586-45fc-b720-e231fcc6a0fe roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138692024-11-18T21:14:14.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b4fa7b7a-0586-45fc-b720-e231fcc6a0fe resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138702024-11-18T21:14:14.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = b4fa7b7a-0586-45fc-b720-e231fcc6a0fe response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138712024-11-18T21:14:15.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f5cf7011-4c8d-4052-bfef-df0bb8325249 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138722024-11-18T21:14:15.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f5cf7011-4c8d-4052-bfef-df0bb8325249 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138732024-11-18T21:14:15.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f5cf7011-4c8d-4052-bfef-df0bb8325249 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138742024-11-18T21:14:16.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
138752024-11-18T21:14:16.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138762024-11-18T21:14:16.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
138772024-11-18T21:14:16.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138782024-11-18T21:14:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138792024-11-18T21:14:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138802024-11-18T21:14:16.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138812024-11-18T21:14:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138822024-11-18T21:14:16.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138832024-11-18T21:14:16.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.672937ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
138842024-11-18T21:14:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138852024-11-18T21:14:16.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138862024-11-18T21:14:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138872024-11-18T21:14:16.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138882024-11-18T21:14:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138892024-11-18T21:14:16.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138902024-11-18T21:14:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
138912024-11-18T21:14:16.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138922024-11-18T21:14:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138932024-11-18T21:14:16.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
138942024-11-18T21:14:16.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.273571ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
138952024-11-18T21:14:16.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30842649-3e21-40f5-987d-b4fbfc258d24 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138962024-11-18T21:14:16.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30842649-3e21-40f5-987d-b4fbfc258d24 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138972024-11-18T21:14:16.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 30842649-3e21-40f5-987d-b4fbfc258d24 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138982024-11-18T21:14:17.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a9110e-4024-415c-9834-2554b772acab roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
138992024-11-18T21:14:17.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a9110e-4024-415c-9834-2554b772acab resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139002024-11-18T21:14:17.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f9a9110e-4024-415c-9834-2554b772acab response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139012024-11-18T21:14:19.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e9721709-156d-4fd5-8f8f-c3b7b8cb8d46 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139022024-11-18T21:14:19.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e9721709-156d-4fd5-8f8f-c3b7b8cb8d46 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139032024-11-18T21:14:19.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e9721709-156d-4fd5-8f8f-c3b7b8cb8d46 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139042024-11-18T21:14:20.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37b3bf1a-8dab-4ba3-9fd5-054d9394ae30 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139052024-11-18T21:14:20.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37b3bf1a-8dab-4ba3-9fd5-054d9394ae30 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139062024-11-18T21:14:20.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 37b3bf1a-8dab-4ba3-9fd5-054d9394ae30 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139072024-11-18T21:14:20.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 604 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 633e656f-4dbd-42fb-b127-7f7e96010c73 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
139082024-11-18T21:14:21.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4b3d79e-4dad-4c9e-b257-85f42a970b57 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139092024-11-18T21:14:21.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4b3d79e-4dad-4c9e-b257-85f42a970b57 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139102024-11-18T21:14:21.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e4b3d79e-4dad-4c9e-b257-85f42a970b57 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139112024-11-18T21:14:22.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ff28419-f36e-469b-9f15-dc7108d6f065 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139122024-11-18T21:14:22.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ff28419-f36e-469b-9f15-dc7108d6f065 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139132024-11-18T21:14:22.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6ff28419-f36e-469b-9f15-dc7108d6f065 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139142024-11-18T21:14:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b053491-2ba4-45e2-aea8-04a28e0afe78 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139152024-11-18T21:14:23.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b053491-2ba4-45e2-aea8-04a28e0afe78 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139162024-11-18T21:14:23.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 4b053491-2ba4-45e2-aea8-04a28e0afe78 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139172024-11-18T21:14:24.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 57be2b46-7a8a-4a19-8eef-87f0c1a90ccd roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139182024-11-18T21:14:24.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 57be2b46-7a8a-4a19-8eef-87f0c1a90ccd resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139192024-11-18T21:14:24.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 57be2b46-7a8a-4a19-8eef-87f0c1a90ccd response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139202024-11-18T21:14:25.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13417bb5-c031-489e-85c9-d8fee0d2bc25 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139212024-11-18T21:14:25.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13417bb5-c031-489e-85c9-d8fee0d2bc25 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139222024-11-18T21:14:25.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 13417bb5-c031-489e-85c9-d8fee0d2bc25 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139232024-11-18T21:14:25.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f09c586d-9157-4e18-8d65-c5660c6639c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
139242024-11-18T21:14:25.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f09c586d-9157-4e18-8d65-c5660c6639c3 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
139252024-11-18T21:14:25.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f09c586d-9157-4e18-8d65-c5660c6639c3 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
139262024-11-18T21:14:25.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 939cbf1f-8156-4420-ab21-19b146d83841 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
139272024-11-18T21:14:25.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 939cbf1f-8156-4420-ab21-19b146d83841 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
139282024-11-18T21:14:25.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 939cbf1f-8156-4420-ab21-19b146d83841 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
139292024-11-18T21:14:26.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0573fe1f-0b04-4ce9-bee9-2e94598420ad roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139302024-11-18T21:14:26.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0573fe1f-0b04-4ce9-bee9-2e94598420ad resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139312024-11-18T21:14:26.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 0573fe1f-0b04-4ce9-bee9-2e94598420ad response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139322024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
139332024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
139342024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139352024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139362024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139372024-11-18T21:14:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139382024-11-18T21:14:26.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139392024-11-18T21:14:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139402024-11-18T21:14:26.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139412024-11-18T21:14:26.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.92328ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139422024-11-18T21:14:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139432024-11-18T21:14:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139442024-11-18T21:14:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139452024-11-18T21:14:26.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139462024-11-18T21:14:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139472024-11-18T21:14:26.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139482024-11-18T21:14:26.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
139492024-11-18T21:14:26.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139502024-11-18T21:14:26.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139512024-11-18T21:14:26.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
139522024-11-18T21:14:26.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.604773ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
139532024-11-18T21:14:27.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2c01a729-6a5c-4ee7-912a-c0da1e4b4a64 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139542024-11-18T21:14:27.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2c01a729-6a5c-4ee7-912a-c0da1e4b4a64 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139552024-11-18T21:14:27.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2c01a729-6a5c-4ee7-912a-c0da1e4b4a64 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139562024-11-18T21:14:28.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa44010d-d233-4602-a15e-1acb1cfdfec6 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139572024-11-18T21:14:28.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa44010d-d233-4602-a15e-1acb1cfdfec6 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139582024-11-18T21:14:28.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = fa44010d-d233-4602-a15e-1acb1cfdfec6 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139592024-11-18T21:14:29.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 656208ed-e2bf-4c11-9168-18d3fb08b70c roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139602024-11-18T21:14:29.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 656208ed-e2bf-4c11-9168-18d3fb08b70c resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139612024-11-18T21:14:29.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 656208ed-e2bf-4c11-9168-18d3fb08b70c response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139622024-11-18T21:14:30.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e27bd11e-2057-4b19-9d6a-3956e500b3f8 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139632024-11-18T21:14:30.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e27bd11e-2057-4b19-9d6a-3956e500b3f8 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139642024-11-18T21:14:30.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e27bd11e-2057-4b19-9d6a-3956e500b3f8 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139652024-11-18T21:14:31.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96f65527-ad8a-4e7a-b5e9-bbe53ab3cef0 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139662024-11-18T21:14:31.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96f65527-ad8a-4e7a-b5e9-bbe53ab3cef0 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139672024-11-18T21:14:31.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 96f65527-ad8a-4e7a-b5e9-bbe53ab3cef0 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139682024-11-18T21:14:32.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 566cd532-0468-437e-8c0f-9062754374a3 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139692024-11-18T21:14:32.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 566cd532-0468-437e-8c0f-9062754374a3 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139702024-11-18T21:14:32.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 566cd532-0468-437e-8c0f-9062754374a3 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139712024-11-18T21:14:33.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 45150b73-6fd2-4d6e-b014-42b922095ece roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139722024-11-18T21:14:33.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 45150b73-6fd2-4d6e-b014-42b922095ece resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139732024-11-18T21:14:33.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 45150b73-6fd2-4d6e-b014-42b922095ece response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139742024-11-18T21:14:34.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d58545f-0635-4054-b342-7f77338ea064 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139752024-11-18T21:14:34.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d58545f-0635-4054-b342-7f77338ea064 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139762024-11-18T21:14:34.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3d58545f-0635-4054-b342-7f77338ea064 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139772024-11-18T21:14:35.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bcef5e0-fc68-48eb-9c12-5d89e5e704e4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139782024-11-18T21:14:35.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bcef5e0-fc68-48eb-9c12-5d89e5e704e4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139792024-11-18T21:14:35.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9bcef5e0-fc68-48eb-9c12-5d89e5e704e4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
139802024-11-18T21:14:35.878ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = f14b7ba4-42e7-410f-a86c-7085bf49cb4a response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
139812024-11-18T21:14:36.244ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
139822024-11-18T21:14:36.244ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
139832024-11-18T21:14:36.244ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
139842024-11-18T21:14:36.244ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139852024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
139862024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139872024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
139882024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139892024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
139902024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
139912024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139922024-11-18T21:14:36.245ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
139932024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139942024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
139952024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
139962024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139972024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
139982024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
139992024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
140002024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140012024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
140022024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140032024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
140042024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
140052024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
140062024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140072024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
140082024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140092024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
140102024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
140112024-11-18T21:14:36.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
140122024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140132024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
140142024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140152024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
140162024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
140172024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140182024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140192024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140202024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
140212024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
140222024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140232024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140242024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140252024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
140262024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
140272024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
140282024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140292024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140302024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140312024-11-18T21:14:36.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140322024-11-18T21:14:36.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 556065902 } })
140332024-11-18T21:14:36.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 556354345 } })
140342024-11-18T21:14:36.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
140352024-11-18T21:14:36.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
140362024-11-18T21:14:36.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140372024-11-18T21:14:36.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140382024-11-18T21:14:36.249ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.747797ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
140392024-11-18T21:14:36.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140402024-11-18T21:14:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
140412024-11-18T21:14:36.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140422024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140432024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
140442024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
140452024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140462024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140472024-11-18T21:14:36.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140482024-11-18T21:14:36.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140492024-11-18T21:14:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140502024-11-18T21:14:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
140512024-11-18T21:14:36.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140522024-11-18T21:14:36.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140532024-11-18T21:14:36.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140542024-11-18T21:14:36.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140552024-11-18T21:14:36.256ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
140562024-11-18T21:14:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
140572024-11-18T21:14:36.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140582024-11-18T21:14:36.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140592024-11-18T21:14:36.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
140602024-11-18T21:14:36.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140612024-11-18T21:14:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140622024-11-18T21:14:36.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
140632024-11-18T21:14:36.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
140642024-11-18T21:14:36.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
140652024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140662024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140672024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140682024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
140692024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140702024-11-18T21:14:36.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140712024-11-18T21:14:36.265ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1785, tv_nsec: 573896945 } })
140722024-11-18T21:14:36.265ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
140732024-11-18T21:14:36.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 19.908068ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
140742024-11-18T21:14:36.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140752024-11-18T21:14:36.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140762024-11-18T21:14:36.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140772024-11-18T21:14:36.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140782024-11-18T21:14:36.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140792024-11-18T21:14:36.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140802024-11-18T21:14:36.268ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140812024-11-18T21:14:36.268ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
140822024-11-18T21:14:36.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140832024-11-18T21:14:36.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140842024-11-18T21:14:36.274ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140852024-11-18T21:14:36.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140862024-11-18T21:14:36.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140872024-11-18T21:14:36.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140882024-11-18T21:14:36.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140892024-11-18T21:14:36.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140902024-11-18T21:14:36.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140912024-11-18T21:14:36.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
140922024-11-18T21:14:36.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140932024-11-18T21:14:36.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140942024-11-18T21:14:36.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140952024-11-18T21:14:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140962024-11-18T21:14:36.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140972024-11-18T21:14:36.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140982024-11-18T21:14:36.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.694693ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
140992024-11-18T21:14:36.299ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.151987ms iteration = 31 status = {"physical_disks_added":0}
141002024-11-18T21:14:36.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.035551ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
141012024-11-18T21:14:36.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
141022024-11-18T21:14:36.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.241572ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
141032024-11-18T21:14:36.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.243092ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
141042024-11-18T21:14:36.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141052024-11-18T21:14:36.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141062024-11-18T21:14:36.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.770351ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
141072024-11-18T21:14:36.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141082024-11-18T21:14:36.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141092024-11-18T21:14:36.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141102024-11-18T21:14:36.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141112024-11-18T21:14:36.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141122024-11-18T21:14:36.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
141132024-11-18T21:14:36.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141142024-11-18T21:14:36.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141152024-11-18T21:14:36.316ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
141162024-11-18T21:14:36.316ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
141172024-11-18T21:14:36.316ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.130213ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
141182024-11-18T21:14:36.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.623306ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
141192024-11-18T21:14:36.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.438073ms iteration = 28 status = 0
141202024-11-18T21:14:36.321ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
141212024-11-18T21:14:36.321ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.653154ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
141222024-11-18T21:14:36.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
141232024-11-18T21:14:36.338ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141242024-11-18T21:14:36.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
141252024-11-18T21:14:36.339ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141262024-11-18T21:14:36.339ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41dfe603-8978-4721-9273-298fe48ded1b", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
141272024-11-18T21:14:36.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141282024-11-18T21:14:36.339ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f94f3e7f-9f4b-4f94-adce-c341b7195476", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
141292024-11-18T21:14:36.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141302024-11-18T21:14:36.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
141312024-11-18T21:14:36.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
141322024-11-18T21:14:36.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
141332024-11-18T21:14:36.368ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141342024-11-18T21:14:36.369ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "478a6876-9b09-4bc5-a5b1-3b8acdb2805c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
141352024-11-18T21:14:36.369ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141362024-11-18T21:14:36.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141372024-11-18T21:14:36.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141382024-11-18T21:14:36.371ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
141392024-11-18T21:14:36.446ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
141402024-11-18T21:14:36.446ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b1e6a39-5817-4058-8521-586773e9a95c", "content-length": "2", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
141412024-11-18T21:14:36.448ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141422024-11-18T21:14:36.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141432024-11-18T21:14:36.450ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.451883ms iteration = 28 status = null
141442024-11-18T21:14:36.452ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
141452024-11-18T21:14:36.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141462024-11-18T21:14:36.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141472024-11-18T21:14:36.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141482024-11-18T21:14:36.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141492024-11-18T21:14:36.462ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.13973ms iteration = 28 status = {}
141502024-11-18T21:14:36.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141512024-11-18T21:14:36.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141522024-11-18T21:14:36.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141532024-11-18T21:14:36.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141542024-11-18T21:14:36.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141552024-11-18T21:14:36.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141562024-11-18T21:14:36.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141572024-11-18T21:14:36.506ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
141582024-11-18T21:14:36.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55400725-cb08-4072-aae7-7e0755623754 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
141592024-11-18T21:14:36.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55400725-cb08-4072-aae7-7e0755623754 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
141602024-11-18T21:14:36.521ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b1f4311-5b8c-4548-9621-95fb8ad00a87", "content-length": "691", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
141612024-11-18T21:14:36.521ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
141622024-11-18T21:14:36.521ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
141632024-11-18T21:14:36.521ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
141642024-11-18T21:14:36.521ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41832d20-5c1e-47be-a15e-bb0f0761afe2", "content-length": "372", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
141652024-11-18T21:14:36.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141662024-11-18T21:14:36.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141672024-11-18T21:14:36.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.607383ms iteration = 29 status = {}
141682024-11-18T21:14:36.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 55400725-cb08-4072-aae7-7e0755623754 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
141692024-11-18T21:14:36.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141702024-11-18T21:14:36.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141712024-11-18T21:14:36.534ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
141722024-11-18T21:14:36.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141732024-11-18T21:14:36.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141742024-11-18T21:14:36.536ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
141752024-11-18T21:14:36.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
141762024-11-18T21:14:36.536ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cce1cb98-7dee-4548-bec9-dc28bb99dcd4", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
141772024-11-18T21:14:36.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141782024-11-18T21:14:36.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141792024-11-18T21:14:36.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141802024-11-18T21:14:36.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141812024-11-18T21:14:36.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141822024-11-18T21:14:36.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141832024-11-18T21:14:36.543ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
141842024-11-18T21:14:36.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "70382a67-7187-410e-9837-74a410218c1a", "content-length": "134", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
141852024-11-18T21:14:36.543ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
141862024-11-18T21:14:36.543ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
141872024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
141882024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
141892024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141902024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141912024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141922024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141932024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141942024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141952024-11-18T21:14:36.544ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
141962024-11-18T21:14:36.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141972024-11-18T21:14:36.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141982024-11-18T21:14:36.545ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
141992024-11-18T21:14:36.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
142002024-11-18T21:14:36.545ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "38d2f913-1a28-48c8-a25f-c5c2833d03f8", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
142012024-11-18T21:14:36.545ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
142022024-11-18T21:14:36.545ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "974a48fc-78d5-49c5-9214-93746a19e363", "content-length": "2", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
142032024-11-18T21:14:36.545ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
142042024-11-18T21:14:36.546ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c4dbbca-8915-4d3b-a69f-4872cf0036d5", "content-length": "51", "date": "Mon, 18 Nov 2024 21:14:35 GMT"} })
142052024-11-18T21:14:36.546ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
142062024-11-18T21:14:36.546ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
142072024-11-18T21:14:36.547ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.494249ms iteration = 29 status = {}
142082024-11-18T21:14:36.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a73ce2ac-efee-4e28-83bf-94d79d043b85", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
142092024-11-18T21:14:36.643ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
142102024-11-18T21:14:36.643ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
142112024-11-18T21:14:36.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f904c69f-e678-4a9b-8ec5-7a4ad3e0d552", "content-length": "682", "date": "Mon, 18 Nov 2024 21:14:36 GMT"} })
142122024-11-18T21:14:36.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142132024-11-18T21:14:36.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142142024-11-18T21:14:36.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142152024-11-18T21:14:36.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142162024-11-18T21:14:36.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142172024-11-18T21:14:36.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142182024-11-18T21:14:36.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142192024-11-18T21:14:36.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142202024-11-18T21:14:36.661ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 415.400509ms iteration = 28 status = {}
142212024-11-18T21:14:37.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4aa97b9-0bd5-4926-bbc7-3bc9e3d26650 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142222024-11-18T21:14:37.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4aa97b9-0bd5-4926-bbc7-3bc9e3d26650 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142232024-11-18T21:14:37.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = f4aa97b9-0bd5-4926-bbc7-3bc9e3d26650 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142242024-11-18T21:14:38.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e20edf8f-c213-468d-85c5-35c31fc46338 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142252024-11-18T21:14:38.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e20edf8f-c213-468d-85c5-35c31fc46338 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142262024-11-18T21:14:38.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e20edf8f-c213-468d-85c5-35c31fc46338 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142272024-11-18T21:14:39.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a1f2d85-d8e0-4ba8-a1f6-18834e30ac05 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142282024-11-18T21:14:39.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a1f2d85-d8e0-4ba8-a1f6-18834e30ac05 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142292024-11-18T21:14:39.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 6a1f2d85-d8e0-4ba8-a1f6-18834e30ac05 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142302024-11-18T21:14:40.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab6b51e8-6a2d-4432-bc80-c028d834034a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142312024-11-18T21:14:40.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab6b51e8-6a2d-4432-bc80-c028d834034a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142322024-11-18T21:14:40.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = ab6b51e8-6a2d-4432-bc80-c028d834034a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142332024-11-18T21:14:40.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = be517f86-9a71-490a-b946-9e3403801d00 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
142342024-11-18T21:14:40.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = be517f86-9a71-490a-b946-9e3403801d00 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
142352024-11-18T21:14:40.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = be517f86-9a71-490a-b946-9e3403801d00 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
142362024-11-18T21:14:40.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 09a583f6-f432-4a9f-b181-c73b61f2f255 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
142372024-11-18T21:14:40.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 09a583f6-f432-4a9f-b181-c73b61f2f255 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
142382024-11-18T21:14:40.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 09a583f6-f432-4a9f-b181-c73b61f2f255 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
142392024-11-18T21:14:41.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39658a77-4ba7-494f-9cec-5d3e72ad0dbc roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142402024-11-18T21:14:41.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39658a77-4ba7-494f-9cec-5d3e72ad0dbc resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142412024-11-18T21:14:41.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 39658a77-4ba7-494f-9cec-5d3e72ad0dbc response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142422024-11-18T21:14:42.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8ec2dde-714c-47db-8549-fa0fc25ccc7b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142432024-11-18T21:14:42.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8ec2dde-714c-47db-8549-fa0fc25ccc7b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142442024-11-18T21:14:42.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = c8ec2dde-714c-47db-8549-fa0fc25ccc7b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142452024-11-18T21:14:43.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3be2594f-e04b-4d81-b8e7-913192a29384 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142462024-11-18T21:14:43.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3be2594f-e04b-4d81-b8e7-913192a29384 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142472024-11-18T21:14:43.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 3be2594f-e04b-4d81-b8e7-913192a29384 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142482024-11-18T21:14:44.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2ef73fa-13cb-496d-8a8f-b0b261989338 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142492024-11-18T21:14:44.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2ef73fa-13cb-496d-8a8f-b0b261989338 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142502024-11-18T21:14:44.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a2ef73fa-13cb-496d-8a8f-b0b261989338 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142512024-11-18T21:14:45.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a5c0eb0-353c-46c9-b9e4-593c844fa4ba roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142522024-11-18T21:14:45.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a5c0eb0-353c-46c9-b9e4-593c844fa4ba resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142532024-11-18T21:14:45.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2a5c0eb0-353c-46c9-b9e4-593c844fa4ba response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142542024-11-18T21:14:46.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
142552024-11-18T21:14:46.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
142562024-11-18T21:14:46.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142572024-11-18T21:14:46.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142582024-11-18T21:14:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142592024-11-18T21:14:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142602024-11-18T21:14:46.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142612024-11-18T21:14:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142622024-11-18T21:14:46.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142632024-11-18T21:14:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142642024-11-18T21:14:46.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142652024-11-18T21:14:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142662024-11-18T21:14:46.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142672024-11-18T21:14:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
142682024-11-18T21:14:46.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142692024-11-18T21:14:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142702024-11-18T21:14:46.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
142712024-11-18T21:14:46.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.800596ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
142722024-11-18T21:14:46.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142732024-11-18T21:14:46.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142742024-11-18T21:14:46.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.045905ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142752024-11-18T21:14:46.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a18d93c0-dd5c-455e-8940-e2037598b08b roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142762024-11-18T21:14:46.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a18d93c0-dd5c-455e-8940-e2037598b08b resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142772024-11-18T21:14:46.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a18d93c0-dd5c-455e-8940-e2037598b08b response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142782024-11-18T21:14:47.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9444517a-406b-4de8-a62f-75b5b4cd8f43 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142792024-11-18T21:14:47.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9444517a-406b-4de8-a62f-75b5b4cd8f43 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142802024-11-18T21:14:47.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9444517a-406b-4de8-a62f-75b5b4cd8f43 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142812024-11-18T21:14:48.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2a100e7-26a3-4256-aad8-53932ce1587d roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142822024-11-18T21:14:48.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2a100e7-26a3-4256-aad8-53932ce1587d resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142832024-11-18T21:14:48.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2a100e7-26a3-4256-aad8-53932ce1587d response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142842024-11-18T21:14:49.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08c11c8b-7065-464a-b9cc-a17c70e14980 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142852024-11-18T21:14:49.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08c11c8b-7065-464a-b9cc-a17c70e14980 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142862024-11-18T21:14:49.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 08c11c8b-7065-464a-b9cc-a17c70e14980 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142872024-11-18T21:14:50.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2788051-1b2e-44ff-aa72-5d60944fbdb4 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142882024-11-18T21:14:50.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2788051-1b2e-44ff-aa72-5d60944fbdb4 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142892024-11-18T21:14:50.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = e2788051-1b2e-44ff-aa72-5d60944fbdb4 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142902024-11-18T21:14:50.880ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 855 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = e3ddde93-4139-4b10-baaa-6070fcc922c0 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
142912024-11-18T21:14:51.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c16223a-dfb9-4a60-9620-ca3c7b5bf328 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142922024-11-18T21:14:51.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c16223a-dfb9-4a60-9620-ca3c7b5bf328 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142932024-11-18T21:14:51.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5c16223a-dfb9-4a60-9620-ca3c7b5bf328 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142942024-11-18T21:14:52.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 95d9ba22-a704-4653-8560-53f739f44105 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142952024-11-18T21:14:52.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 95d9ba22-a704-4653-8560-53f739f44105 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142962024-11-18T21:14:52.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 95d9ba22-a704-4653-8560-53f739f44105 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142972024-11-18T21:14:53.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5f3ddf51-fec7-4567-a900-ecc4a771b389 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142982024-11-18T21:14:53.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5f3ddf51-fec7-4567-a900-ecc4a771b389 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
142992024-11-18T21:14:53.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 5f3ddf51-fec7-4567-a900-ecc4a771b389 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143002024-11-18T21:14:54.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8bdeeb25-6975-4139-9773-e6f971c26ca7 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143012024-11-18T21:14:54.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8bdeeb25-6975-4139-9773-e6f971c26ca7 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143022024-11-18T21:14:54.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8bdeeb25-6975-4139-9773-e6f971c26ca7 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143032024-11-18T21:14:55.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 36207be1-cc7a-414d-9ee8-8a57d00f3d36 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
143042024-11-18T21:14:55.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 36207be1-cc7a-414d-9ee8-8a57d00f3d36 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
143052024-11-18T21:14:55.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = 36207be1-cc7a-414d-9ee8-8a57d00f3d36 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?sort_by=id_ascending
143062024-11-18T21:14:55.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f40aa3d3-6bc2-46ca-8bbf-eade3d906299 roles = RoleSet { roles: {} } uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
143072024-11-18T21:14:55.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f40aa3d3-6bc2-46ca-8bbf-eade3d906299 resource = Database result = Ok(()) uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
143082024-11-18T21:14:55.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48240 req_id = f40aa3d3-6bc2-46ca-8bbf-eade3d906299 response_code = 200 uri = /metrics/collectors/84b5a094-9eb0-4ff8-be58-5c4913059740/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWUxYjg3Ny01ZDlmLTQ0MjYtYmVhZC05NGQ4MzJjYjFhMWQifX0%3D
143092024-11-18T21:14:55.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c839296-bb96-4273-a767-3014e9b74903 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143102024-11-18T21:14:55.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c839296-bb96-4273-a767-3014e9b74903 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143112024-11-18T21:14:55.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 9c839296-bb96-4273-a767-3014e9b74903 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143122024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
143132024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
143142024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143152024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143162024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143172024-11-18T21:14:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143182024-11-18T21:14:56.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143192024-11-18T21:14:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143202024-11-18T21:14:56.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143212024-11-18T21:14:56.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143222024-11-18T21:14:56.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143232024-11-18T21:14:56.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143242024-11-18T21:14:56.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143252024-11-18T21:14:56.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
143262024-11-18T21:14:56.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143272024-11-18T21:14:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143282024-11-18T21:14:56.270ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
143292024-11-18T21:14:56.270ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.653407ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
143302024-11-18T21:14:56.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143312024-11-18T21:14:56.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143322024-11-18T21:14:56.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.62935ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
143332024-11-18T21:14:56.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c73e735-8d6c-4f48-835b-67e358a12587 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143342024-11-18T21:14:56.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c73e735-8d6c-4f48-835b-67e358a12587 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143352024-11-18T21:14:56.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 8c73e735-8d6c-4f48-835b-67e358a12587 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143362024-11-18T21:14:58.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e4b0bd9-4607-4613-80f6-4199d75bad77 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143372024-11-18T21:14:58.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e4b0bd9-4607-4613-80f6-4199d75bad77 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143382024-11-18T21:14:58.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 7e4b0bd9-4607-4613-80f6-4199d75bad77 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143392024-11-18T21:14:59.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 589c32f1-33df-44ff-93a1-7df8b4d29526 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143402024-11-18T21:14:59.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 589c32f1-33df-44ff-93a1-7df8b4d29526 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143412024-11-18T21:14:59.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 589c32f1-33df-44ff-93a1-7df8b4d29526 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143422024-11-18T21:15:00.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2180f3d4-dfab-464a-ad65-736ce70f601a roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143432024-11-18T21:15:00.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2180f3d4-dfab-464a-ad65-736ce70f601a resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143442024-11-18T21:15:00.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 2180f3d4-dfab-464a-ad65-736ce70f601a response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143452024-11-18T21:15:01.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3c6b018-f122-4784-b75a-e7e3e52bbd59 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143462024-11-18T21:15:01.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3c6b018-f122-4784-b75a-e7e3e52bbd59 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143472024-11-18T21:15:01.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = a3c6b018-f122-4784-b75a-e7e3e52bbd59 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143482024-11-18T21:15:02.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26859504-2339-4fa4-9d00-d1628f3464ae roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143492024-11-18T21:15:02.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26859504-2339-4fa4-9d00-d1628f3464ae resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143502024-11-18T21:15:02.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 26859504-2339-4fa4-9d00-d1628f3464ae response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143512024-11-18T21:15:03.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52471529-391c-444b-a6e5-7903c6a67087 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143522024-11-18T21:15:03.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52471529-391c-444b-a6e5-7903c6a67087 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143532024-11-18T21:15:03.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 52471529-391c-444b-a6e5-7903c6a67087 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143542024-11-18T21:15:04.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 941f0d88-0c54-4321-9119-93ce4ff270ef roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143552024-11-18T21:15:04.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 941f0d88-0c54-4321-9119-93ce4ff270ef resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143562024-11-18T21:15:04.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 941f0d88-0c54-4321-9119-93ce4ff270ef response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143572024-11-18T21:15:05.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41f3560d-588f-42ff-a868-ace8160ad463 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143582024-11-18T21:15:05.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41f3560d-588f-42ff-a868-ace8160ad463 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143592024-11-18T21:15:05.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 41f3560d-588f-42ff-a868-ace8160ad463 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143602024-11-18T21:15:05.881ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:52336 req_id = 21d82f06-115e-4d4f-86f3-62b2a7701333 response_code = 200 uri = /3dce42ed-74cb-4c8b-9326-8273a1efd563
143612024-11-18T21:15:06.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dcb59c0-aa8b-42bd-aa18-f853b3758f44 roles = RoleSet { roles: {} } uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143622024-11-18T21:15:06.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dcb59c0-aa8b-42bd-aa18-f853b3758f44 resource = Database result = Ok(()) uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143632024-11-18T21:15:06.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38868 req_id = 1dcb59c0-aa8b-42bd-aa18-f853b3758f44 response_code = 200 uri = /probes/79cbda5a-2e27-489e-945d-860d86dec819
143642024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
143652024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
143662024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143672024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
143682024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
143692024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
143702024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143712024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
143722024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
143732024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
143742024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
143752024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
143762024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143772024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
143782024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
143792024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
143802024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
143812024-11-18T21:15:06.245ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-18 21:05:06.245328159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
143822024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
143832024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
143842024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143852024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
143862024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
143872024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143882024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143892024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
143902024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
143912024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
143922024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143932024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143942024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
143952024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
143962024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
143972024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
143982024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143992024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
144002024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
144012024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
144022024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
144032024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
144042024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
144052024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
144062024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
144072024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
144082024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
144092024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144102024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
144112024-11-18T21:15:06.245ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d
144122024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.02\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d"}
144132024-11-18T21:15:06.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
144142024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
144152024-11-18T21:15:06.246ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
144162024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
144172024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
144182024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
144192024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144202024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
144212024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
144222024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
144232024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
144242024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
144252024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
144262024-11-18T21:15:06.246ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
144272024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
144282024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144292024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144302024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
144312024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144322024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
144332024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144342024-11-18T21:15:06.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("14e637a2-51ce-4cac-b831-85b757e5c55d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be35e232-dd9b-4d59-b4e1-eadb7f69bb77.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 554471450 } })
144352024-11-18T21:15:06.246ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4554ce4c-90f4-4fd2-93bd-086596238122.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62e83095-0557-4ac0-8b12-7429e79e4bb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9e770f2-88d4-4893-909a-79400af2db8b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 554502601 } })
144362024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
144372024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
144382024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144392024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144402024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144412024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
144422024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
144432024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144442024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
144452024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
144462024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144472024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144482024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
144492024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
144502024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144512024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144522024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
144532024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.35907ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
144542024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
144552024-11-18T21:15:06.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.465371ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
144562024-11-18T21:15:06.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 556646127 } })
144572024-11-18T21:15:06.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144582024-11-18T21:15:06.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
144592024-11-18T21:15:06.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144602024-11-18T21:15:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144612024-11-18T21:15:06.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144622024-11-18T21:15:06.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 557632194 } })
144632024-11-18T21:15:06.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
144642024-11-18T21:15:06.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144652024-11-18T21:15:06.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
144662024-11-18T21:15:06.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144672024-11-18T21:15:06.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144682024-11-18T21:15:06.254ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-18 21:05:06.245328159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
144692024-11-18T21:15:06.254ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.085698ms iteration = 15 status = {"expiration":"2024-11-18T21:05:06.245328159Z","pruned":[]}
144702024-11-18T21:15:06.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144712024-11-18T21:15:06.256ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.042995ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
144722024-11-18T21:15:06.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.935712ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
144732024-11-18T21:15:06.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144742024-11-18T21:15:06.257ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144752024-11-18T21:15:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144762024-11-18T21:15:06.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
144772024-11-18T21:15:06.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
144782024-11-18T21:15:06.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
144792024-11-18T21:15:06.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144802024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
144812024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144822024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144832024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144842024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144852024-11-18T21:15:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144862024-11-18T21:15:06.264ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144872024-11-18T21:15:06.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144882024-11-18T21:15:06.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144892024-11-18T21:15:06.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144902024-11-18T21:15:06.267ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
144912024-11-18T21:15:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144922024-11-18T21:15:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
144932024-11-18T21:15:06.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144942024-11-18T21:15:06.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144952024-11-18T21:15:06.271ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144962024-11-18T21:15:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
144972024-11-18T21:15:06.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144982024-11-18T21:15:06.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144992024-11-18T21:15:06.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
145002024-11-18T21:15:06.274ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
145012024-11-18T21:15:06.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
145022024-11-18T21:15:06.276ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.484987ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
145032024-11-18T21:15:06.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145042024-11-18T21:15:06.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145052024-11-18T21:15:06.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145062024-11-18T21:15:06.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145072024-11-18T21:15:06.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145082024-11-18T21:15:06.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
145092024-11-18T21:15:06.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145102024-11-18T21:15:06.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145112024-11-18T21:15:06.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145122024-11-18T21:15:06.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.838545ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145132024-11-18T21:15:06.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
145142024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
145152024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
145162024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
145172024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
145182024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
145192024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145202024-11-18T21:15:06.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145212024-11-18T21:15:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145222024-11-18T21:15:06.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145232024-11-18T21:15:06.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.351281ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145242024-11-18T21:15:06.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-79cbda5a-2e27-489e-945d-860d86dec819.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1815, tv_nsec: 595077483 } })
145252024-11-18T21:15:06.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145262024-11-18T21:15:06.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
145272024-11-18T21:15:06.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145282024-11-18T21:15:06.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145292024-11-18T21:15:06.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145302024-11-18T21:15:06.289ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
145312024-11-18T21:15:06.289ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.421714ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
145322024-11-18T21:15:06.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145332024-11-18T21:15:06.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
145342024-11-18T21:15:06.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
145352024-11-18T21:15:06.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
145362024-11-18T21:15:06.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
145372024-11-18T21:15:06.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145382024-11-18T21:15:06.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145392024-11-18T21:15:06.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 85335814-6ca7-46f1-a0ca-b57a6859759d, lookup_type: ById(85335814-6ca7-46f1-a0ca-b57a6859759d) } result = Ok(())
145402024-11-18T21:15:06.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145412024-11-18T21:15:06.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145422024-11-18T21:15:06.296ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145432024-11-18T21:15:06.296ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
145442024-11-18T21:15:06.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
145452024-11-18T21:15:06.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
145462024-11-18T21:15:06.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145472024-11-18T21:15:06.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145482024-11-18T21:15:06.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.194814ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
145492024-11-18T21:15:06.305ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
145502024-11-18T21:15:06.305ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
145512024-11-18T21:15:06.305ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.425873ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
145522024-11-18T21:15:06.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
145532024-11-18T21:15:06.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
145542024-11-18T21:15:06.317ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d original_time_created = 2024-11-18 21:00:58.709116 UTC target_id = 85335814-6ca7-46f1-a0ca-b57a6859759d time_created = 2024-11-18 21:00:58.709116 UTC
145552024-11-18T21:15:06.317ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.840456ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"85335814-6ca7-46f1-a0ca-b57a6859759d","time_created":"2024-11-18T21:00:58.709116Z"}
145562024-11-18T21:15:06.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145572024-11-18T21:15:06.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145582024-11-18T21:15:06.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145592024-11-18T21:15:06.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145602024-11-18T21:15:06.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145612024-11-18T21:15:06.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145622024-11-18T21:15:06.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145632024-11-18T21:15:06.326ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
145642024-11-18T21:15:06.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
145652024-11-18T21:15:06.327ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
145662024-11-18T21:15:06.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
145672024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
145682024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
145692024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
145702024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145712024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145722024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145732024-11-18T21:15:06.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145742024-11-18T21:15:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 79cbda5a-2e27-489e-945d-860d86dec819, lookup_type: ById(79cbda5a-2e27-489e-945d-860d86dec819) } result = Ok(())
145752024-11-18T21:15:06.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145762024-11-18T21:15:06.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145772024-11-18T21:15:06.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
145782024-11-18T21:15:06.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145792024-11-18T21:15:06.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
145802024-11-18T21:15:06.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
145812024-11-18T21:15:06.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145822024-11-18T21:15:06.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145832024-11-18T21:15:06.340ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.113642ms iteration = 29 status = 0
145842024-11-18T21:15:06.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145852024-11-18T21:15:06.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145862024-11-18T21:15:06.344ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
145872024-11-18T21:15:06.344ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 0 version = 2
145882024-11-18T21:15:06.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145892024-11-18T21:15:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145902024-11-18T21:15:06.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
145912024-11-18T21:15:06.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145922024-11-18T21:15:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145932024-11-18T21:15:06.345ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
145942024-11-18T21:15:06.345ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
145952024-11-18T21:15:06.345ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 99.780324ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
145962024-11-18T21:15:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145972024-11-18T21:15:06.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145982024-11-18T21:15:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145992024-11-18T21:15:06.347ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.244006ms iteration = 32 status = {"physical_disks_added":0}
146002024-11-18T21:15:06.348ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
146012024-11-18T21:15:06.348ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
146022024-11-18T21:15:06.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146032024-11-18T21:15:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146042024-11-18T21:15:06.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.466186ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
146052024-11-18T21:15:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.706572ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
146062024-11-18T21:15:06.408ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
146072024-11-18T21:15:06.408ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 162.705614ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
146082024-11-18T21:15:06.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146092024-11-18T21:15:06.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146102024-11-18T21:15:06.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 zone_address = fd00:1122:3344:101::2
146112024-11-18T21:15:06.435ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
146122024-11-18T21:15:06.435ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ff1acb8-42ae-4e1c-965c-6db8d1cecd4c", "content-length": "26", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
146132024-11-18T21:15:06.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
146142024-11-18T21:15:06.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
146152024-11-18T21:15:06.511ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
146162024-11-18T21:15:06.511ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146172024-11-18T21:15:06.512ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "120c85e0-5e64-46af-9922-83ccd9a1904f", "content-length": "372", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
146182024-11-18T21:15:06.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146192024-11-18T21:15:06.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146202024-11-18T21:15:06.513ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
146212024-11-18T21:15:06.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146222024-11-18T21:15:06.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146232024-11-18T21:15:06.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
146242024-11-18T21:15:06.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
146252024-11-18T21:15:06.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
146262024-11-18T21:15:06.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
146272024-11-18T21:15:06.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146282024-11-18T21:15:06.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146292024-11-18T21:15:06.518ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8e3e23bf-8e1c-43dc-b356-2377aefb9ff0 dns_zone_name = oxide.test found_so_far = 1 version = 2
146302024-11-18T21:15:06.519ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
146312024-11-18T21:15:06.519ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-18 21:02:13.458060 UTC dns_group = external generation = 2
146322024-11-18T21:15:06.519ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 273.749092ms iteration = 15 status = {"generation":2}
146332024-11-18T21:15:06.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146342024-11-18T21:15:06.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
146352024-11-18T21:15:06.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146362024-11-18T21:15:06.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146372024-11-18T21:15:06.540ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
146382024-11-18T21:15:06.540ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
146392024-11-18T21:15:06.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
146402024-11-18T21:15:06.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
146412024-11-18T21:15:06.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146422024-11-18T21:15:06.543ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
146432024-11-18T21:15:06.543ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
146442024-11-18T21:15:06.543ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 297.299508ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
146452024-11-18T21:15:06.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
146462024-11-18T21:15:06.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
146472024-11-18T21:15:06.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
146482024-11-18T21:15:06.548ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-18T21:01:04.001690Z, time_modified: 2024-11-18T21:01:04.001690Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, db_silo: Silo { identity: SiloIdentity { id: ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-18T21:02:13.413251Z, time_modified: 2024-11-18T21:02:13.413251Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538" }] }) }
146492024-11-18T21:15:06.548ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 303.606855ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]}},"default_endpoint":{"silo_id":"ea8b3055-5ecf-4ed0-93a8-fdadd18e20b8","tls_certs":["edc3517ed9068d612b4de88bdedf0e4cecd0452ee1032f91eeea569a6b1c6538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
146502024-11-18T21:15:06.556ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
146512024-11-18T21:15:06.556ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
146522024-11-18T21:15:06.562ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
146532024-11-18T21:15:06.562ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
146542024-11-18T21:15:06.562ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a539cc4-b423-49ad-9f09-0e10f0c716a4", "content-length": "26", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
146552024-11-18T21:15:06.562ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
146562024-11-18T21:15:06.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
146572024-11-18T21:15:06.570ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
146582024-11-18T21:15:06.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
146592024-11-18T21:15:06.594ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
146602024-11-18T21:15:06.594ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff3fde7d-bbc2-437e-ba51-fda9ab28a788", "content-length": "26", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
146612024-11-18T21:15:06.594ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
146622024-11-18T21:15:06.596ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
146632024-11-18T21:15:06.630ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f9ab703b-b48c-4ad0-b68f-94796cc13f6e", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
146642024-11-18T21:15:06.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146652024-11-18T21:15:06.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146662024-11-18T21:15:06.687ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
146672024-11-18T21:15:06.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2de487c-26d1-45b0-8875-d5b95242cb53", "content-length": "691", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
146682024-11-18T21:15:06.687ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
146692024-11-18T21:15:06.687ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
146702024-11-18T21:15:06.687ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
146712024-11-18T21:15:06.688ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 442.912094ms iteration = 30 status = {}
146722024-11-18T21:15:06.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146732024-11-18T21:15:06.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146742024-11-18T21:15:06.690ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9e784572-a879-4067-ad99-33e53e02a644 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
146752024-11-18T21:15:06.690ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
146762024-11-18T21:15:06.690ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-18 21:02:12.545857 UTC dns_group = internal generation = 1
146772024-11-18T21:15:06.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 445.14426ms iteration = 15 status = {"generation":1}
146782024-11-18T21:15:06.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146792024-11-18T21:15:06.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146802024-11-18T21:15:06.695ZINFOnexus (BackgroundTasks): VPC route manager sled 79cbda5a-2e27-489e-945d-860d86dec819 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
146812024-11-18T21:15:06.695ZDEBGnexus (BackgroundTasks): client request SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146822024-11-18T21:15:06.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 79cbda5a-2e27-489e-945d-860d86dec819 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dbb417af-604c-4310-9535-af02cb5bf8da", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
146832024-11-18T21:15:06.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.335507ms iteration = 30 status = {}
146842024-11-18T21:15:06.701ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
146852024-11-18T21:15:06.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9f50d98b-2ba2-414e-b43f-a7af286121a5", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146862024-11-18T21:15:06.702ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146872024-11-18T21:15:06.704ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "da1fd332-61db-40f9-82e6-ba25112e1640", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146882024-11-18T21:15:06.704ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146892024-11-18T21:15:06.706ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
146902024-11-18T21:15:06.706ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 460.869828ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
146912024-11-18T21:15:06.722ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
146922024-11-18T21:15:06.722ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac85b5a0-effa-4b6f-9fca-6dab067ffb18", "content-length": "2", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
146932024-11-18T21:15:06.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
146942024-11-18T21:15:06.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
146952024-11-18T21:15:06.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
146962024-11-18T21:15:06.726ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 481.559142ms iteration = 29 status = null
146972024-11-18T21:15:06.731ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.7159ms iteration = 29 status = {}
146982024-11-18T21:15:06.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
146992024-11-18T21:15:06.789ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "65bc0162-8232-4b11-9977-1fba1ca39b47", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147002024-11-18T21:15:06.789ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147012024-11-18T21:15:06.791ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1e40970-92f5-482c-be01-9043c26fbfb3", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147022024-11-18T21:15:06.791ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147032024-11-18T21:15:06.792ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "85d5a9df-737f-4ad7-9e36-16d64adb4b7a", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147042024-11-18T21:15:06.792ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147052024-11-18T21:15:06.793ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
147062024-11-18T21:15:06.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.47404ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
147072024-11-18T21:15:06.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147082024-11-18T21:15:06.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147092024-11-18T21:15:06.796ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3c03658d-c2aa-4752-95d9-920faabaa689, rack_id: f35dae23-a43a-4d77-a204-fab3c4bdfff3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8cd3100c-3391-430b-b5ab-1dda2a8732f9) } rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
147102024-11-18T21:15:06.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147112024-11-18T21:15:06.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147122024-11-18T21:15:06.806ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
147132024-11-18T21:15:06.806ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "48c9a714-41c1-4840-80cd-f8f0c39eadd1", "content-length": "134", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
147142024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
147152024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8cd3100c-3391-430b-b5ab-1dda2a8732f9
147162024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
147172024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
147182024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147192024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147202024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147212024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
147222024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
147232024-11-18T21:15:06.806ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
147242024-11-18T21:15:06.807ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3
147252024-11-18T21:15:06.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147262024-11-18T21:15:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147272024-11-18T21:15:06.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
147282024-11-18T21:15:06.809ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e1f3702-cf1e-42d7-89ec-3106200f39fc", "content-length": "2", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
147292024-11-18T21:15:06.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
147302024-11-18T21:15:06.809ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d676a6f-0ea2-4004-bc71-e09f28114e9d", "content-length": "51", "date": "Mon, 18 Nov 2024 21:15:05 GMT"} })
147312024-11-18T21:15:06.809ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch_location = Switch0
147322024-11-18T21:15:06.809ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
147332024-11-18T21:15:06.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9680b02c-1f90-4653-b240-1e9eff7c67ba", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
147342024-11-18T21:15:06.906ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 switch = Switch0
147352024-11-18T21:15:06.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
147362024-11-18T21:15:06.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f35dae23-a43a-4d77-a204-fab3c4bdfff3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "16fb23c2-bd36-47d9-84c0-70139c7db8ff", "content-length": "682", "date": "Mon, 18 Nov 2024 21:15:06 GMT"} })
147372024-11-18T21:15:06.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147382024-11-18T21:15:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147392024-11-18T21:15:06.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147402024-11-18T21:15:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147412024-11-18T21:15:06.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147422024-11-18T21:15:06.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147432024-11-18T21:15:06.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147442024-11-18T21:15:06.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147452024-11-18T21:15:06.924ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 678.223909ms iteration = 29 status = {}